-- Logs begin at Wed 2022-08-24 06:03:25 UTC, end at Wed 2022-08-24 07:21:37 UTC. -- Aug 24 06:36:17.197207 dv-cinder-854272-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 24 06:36:17.207530 dv-cinder-854272-1-smb devstack@keystone.service[93376]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 24 06:36:17 2022] *** Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: nodename: dv-cinder-854272-1-smb Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: machine: x86_64 Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: clock source: unix Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: pcre jit disabled Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: detected number of CPU cores: 4 Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: current working directory: / Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: detected binary path: /usr/bin/uwsgi-core Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: your processes number limit is 47680 Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: your memory page size is 4096 bytes Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: detected max file descriptor number: 2048 Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: lock engine: pthread robust mutexes Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: thunder lock: enabled Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 24 06:36:17.210855 dv-cinder-854272-1-smb devstack@keystone.service[93376]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 24 06:36:17.250163 dv-cinder-854272-1-smb devstack@keystone.service[93376]: Python main interpreter initialized at 0x55611fb559c0 Aug 24 06:36:17.250163 dv-cinder-854272-1-smb devstack@keystone.service[93376]: python threads support enabled Aug 24 06:36:17.250163 dv-cinder-854272-1-smb devstack@keystone.service[93376]: your server socket listen backlog is limited to 100 connections Aug 24 06:36:17.250163 dv-cinder-854272-1-smb devstack@keystone.service[93376]: your mercy for graceful operations on workers is 90 seconds Aug 24 06:36:17.250547 dv-cinder-854272-1-smb devstack@keystone.service[93376]: mapped 403077 bytes (393 KB) for 2 cores Aug 24 06:36:17.250625 dv-cinder-854272-1-smb devstack@keystone.service[93376]: *** Operational MODE: preforking *** Aug 24 06:36:17.250878 dv-cinder-854272-1-smb devstack@keystone.service[93376]: *** uWSGI is running in multiple interpreter mode *** Aug 24 06:36:17.250878 dv-cinder-854272-1-smb devstack@keystone.service[93376]: spawned uWSGI master process (pid: 93376) Aug 24 06:36:17.251088 dv-cinder-854272-1-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 24 06:36:17.251963 dv-cinder-854272-1-smb devstack@keystone.service[93376]: spawned uWSGI worker 1 (pid: 93390, cores: 1) Aug 24 06:36:17.251963 dv-cinder-854272-1-smb devstack@keystone.service[93376]: spawned uWSGI worker 2 (pid: 93391, cores: 1) Aug 24 06:36:17.253468 dv-cinder-854272-1-smb devstack@keystone.service[93376]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 24 06:36:21.606534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:36:21.606534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: from cryptography.utils import int_from_bytes Aug 24 06:36:21.607382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:36:21.607382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: from cryptography.utils import int_from_bytes Aug 24 06:36:21.607935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:36:21.607935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: from cryptography.utils import int_from_bytes Aug 24 06:36:21.608425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 24 06:36:21.608425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: from cryptography.utils import int_from_bytes Aug 24 06:36:21.660517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:36:21.660732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:36:21.660910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] command line args: [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:36:21.661193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:36:21.661371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ================================================================================ {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:36:21.661661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] admin_token = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.661795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 24 06:36:21.661881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] config_dir = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.661996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 24 06:36:21.662082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.662217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] command line args: [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 24 06:36:21.662310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] config_source = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.662391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] debug = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.662456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 24 06:36:21.662578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.662972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ================================================================================ {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 24 06:36:21.662972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] admin_token = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] config_dir = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] config_source = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] debug = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.663895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] list_limit = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] log_config_append = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] insecure_debug = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] log_dir = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] log_file = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.664962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] list_limit = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] log_config_append = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] log_dir = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.665935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] log_file = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.666929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.667925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.668079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.668318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.668396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.668573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.668660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] publish_errors = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.668803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.668888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.669036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.669126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] notification_format = cadf {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.669199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.669313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.669451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.669696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] standard_threads = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] publish_errors = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.670898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] use_journal = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] use_json = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] use_stderr = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] use_syslog = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] standard_threads = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] strict_password_check = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.671952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.672123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.672206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.672303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] use_eventlog = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.672427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.672506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] use_journal = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.672650 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] use_json = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.672732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.672828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] use_stderr = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.672911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.673057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] use_syslog = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.673130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.673230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] watch_log_file = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 24 06:36:21.673368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.673494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.673608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.673742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.673858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.674885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.675845 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.676844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677021 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.677998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.678086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.678232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.678322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.678463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.678547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.678698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.678875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.679985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.680969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.681906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.682951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.683943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684337 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.684894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.685989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.686100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.686227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.686331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.686466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.686588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.686686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.686904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.687894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.688942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.689892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.690890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.enabled = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.691820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.692030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.692679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.694621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.694842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.694961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.699651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.699785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.699887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700765 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700836 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700906 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.700977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.701972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] auth.external = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.702972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] auth.password = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] auth.token = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703267 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] auth.external = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] auth.mapped = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.703945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] auth.password = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] credential.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] auth.token = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] catalog.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.704993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] credential.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] credential.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.705994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.706979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.707749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.708952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709317 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.709992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.710993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.711997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712760 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.712957 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713247 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.713924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.714858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.715987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.716878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.717978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.password = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.718980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.719953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.720930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.721956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.722107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.722187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.722354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.722518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.722598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.722777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.722874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.723979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.724106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.724232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.724357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.724491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.724616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.724742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.724912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.725901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.726035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.726148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.726289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.726376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.726529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.726608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.726815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.734974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] policy.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.735963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] receipt.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] role.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] role.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.736987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.737966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] revoke.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] role.cache_time = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] role.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] role.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] role.list_limit = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.738899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.739882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.740931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.741964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.742941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.743981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.cache_time = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.provider = fernet {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.connection = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.744980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] trust.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.745969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.746932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.connection = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.747744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:36:21.747807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.748057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.748299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.748542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.748785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.749036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.749278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.749529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.749772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.750025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.750269 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.750520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.750778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.751037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.751454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 24 06:36:21.751454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=93391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 24 06:36:21.781569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.781844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.781988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.782883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.783123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.783352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.790372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.791914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.819413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.819656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.821334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.821575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.873858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.877284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.923591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.923855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.923998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:21.924154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.092150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.092430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.092578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.092720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.092890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.093024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.093154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.093297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.093431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.093578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.093711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.093841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.123243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.123509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.123689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.123827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.123997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.124136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.124268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.124397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.124535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.124664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.124792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.124919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.125048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.125195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.142812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.143130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.156572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.156821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.156986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.157125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.157256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.157387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.157517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.157687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.157865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.157996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.158124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.158275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.158403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93390) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.158540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=93391) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 24 06:36:22.174601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.174830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 06:36:22.175177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.175377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 06:36:22.177670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.177780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.177865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 06:36:22.177944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.178020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.178095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.178181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 24 06:36:22.178259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.178334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.178334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.178334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.178334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.185957 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.186231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.186502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.186795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.187086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.187363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.187632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.187907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.194230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.195340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.197103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.197384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.197675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.197960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.198179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.198282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.198459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.198543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.198742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.198843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.199054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.200594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.200683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.200761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.200835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.200910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.200998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.201076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.201152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.201152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.201152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.201152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.222626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.223799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.224124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.224408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.225245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.228044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.229028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.229310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.229594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.230138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.230422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.230699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.235863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.236148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.237012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.237289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.240230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.240521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.240805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.241087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.241361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.241457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.241634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.241720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.241904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.241987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.242172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.242258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.242441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.242714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.243006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.243273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.259610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.259898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.260745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.261026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.263720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.264947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.266923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.267218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.268139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.268446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.271967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.273190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.275126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.276343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.278307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.278601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.278916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.279202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.279488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.279602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.279779 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.279910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.280490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.280763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.281051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.295815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.296109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.296387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.296651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.297083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.297386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.297657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.297923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.303692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.304844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.305208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.305494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.306357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.306634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.308145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.308438 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.308736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.309025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.309278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.309369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.309565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.309863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.310158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.310437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.321022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.321353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.321575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.321856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.322135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.322267 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.322408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.322542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.322669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.322816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.323062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.323341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.323616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.323904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.338516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.339755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.341561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.342795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.344448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.345654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.345872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.347116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.352814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.352814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.352814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.353079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.353079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.353079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.354298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.355591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.355763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.357053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.358698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.359019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.359305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.359583 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.359970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.360269 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.360563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.360849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.367504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.367793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.368077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.368758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.369053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.369332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.375723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93390) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.375723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.375723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.375723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.376258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.376386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=93391) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 24 06:36:22.376513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.376513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.376758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.376887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.377944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.378081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.378207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.378333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.378470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93390) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.378598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.378598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.378876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.379097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.379360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.380153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=93391) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 24 06:36:22.413989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55611fb559c0 pid: 93390 (default app) Aug 24 06:36:22.414706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55611fb559c0 pid: 93391 (default app) Aug 24 06:36:22.417656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ba7f2-7aa4-4959-ad29-05223f075048 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:22.417941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ba7f2-7aa4-4959-ad29-05223f075048 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:22.418212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4ba7f2-7aa4-4959-ad29-05223f075048 None None] PATH_INFO: `/v3` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:22.422648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Wed Aug 24 06:36:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:30.043106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97597-e87e-413f-bd15-3bcea1082805 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:30.043640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97597-e87e-413f-bd15-3bcea1082805 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:30.043726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd97597-e87e-413f-bd15-3bcea1082805 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:30.048231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:36:30.055819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:30.056218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:30.056324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:30.127659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: INFO dbcounter [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] Registered counter for database keystone Aug 24 06:36:30.149394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG oslo_db.sqlalchemy.engines [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:36:30.155943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writer thread running {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:36:30.340875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG passlib.handlers.bcrypt [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93390) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 06:36:30.341221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG passlib.handlers.bcrypt [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93390) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 06:36:30.396305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:30.397927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:30.528834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 06:36:30.987308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97597-e87e-413f-bd15-3bcea1082805 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:31.056175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: INFO dbcounter [None req-9fd97597-e87e-413f-bd15-3bcea1082805 None None] Registered counter for database keystone Aug 24 06:36:31.076376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG oslo_db.sqlalchemy.engines [None req-9fd97597-e87e-413f-bd15-3bcea1082805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 24 06:36:31.082547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writer thread running {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 24 06:36:31.201827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd97597-e87e-413f-bd15-3bcea1082805 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:31.206171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131b5c5-f8d9-4b0a-a478-dd0d1748f298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:31.206819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131b5c5-f8d9-4b0a-a478-dd0d1748f298 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:31.207106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131b5c5-f8d9-4b0a-a478-dd0d1748f298 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:31.207415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131b5c5-f8d9-4b0a-a478-dd0d1748f298 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:31.216029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131b5c5-f8d9-4b0a-a478-dd0d1748f298 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:31.267073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0131b5c5-f8d9-4b0a-a478-dd0d1748f298 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 06:36:31.267365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131b5c5-f8d9-4b0a-a478-dd0d1748f298 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:31.277365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Wed Aug 24 06:36:30 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 06:36:31.283708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:31.298997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ec474d-2a5a-4846-afa2-e3ed98beaf1f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:31.304103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4889f6c3-1083-40ac-9a40-7c32ae368c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:31.305218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f6c3-1083-40ac-9a40-7c32ae368c20 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:31.305503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f6c3-1083-40ac-9a40-7c32ae368c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:31.305777 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4889f6c3-1083-40ac-9a40-7c32ae368c20 admin admin] PATH_INFO: `/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:31.307379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f6c3-1083-40ac-9a40-7c32ae368c20 admin admin] RBAC: Authorizing `identity:get_project(project_id=a64c6bc3685d4c718b6ea09aa1a4b7cf)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:31.359079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4889f6c3-1083-40ac-9a40-7c32ae368c20 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 24 06:36:31.359428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4889f6c3-1083-40ac-9a40-7c32ae368c20 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:31.364552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Wed Aug 24 06:36:31 2022] GET /identity/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:33.266334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793983d-bb39-43b0-a8eb-8dd0a4cf399a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:33.266935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793983d-bb39-43b0-a8eb-8dd0a4cf399a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:33.266935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793983d-bb39-43b0-a8eb-8dd0a4cf399a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:33.271083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:33.276883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f187d4-8a09-44d3-a526-f598c0f8cb13 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:33.277375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f187d4-8a09-44d3-a526-f598c0f8cb13 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:33.277548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f187d4-8a09-44d3-a526-f598c0f8cb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:33.297682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-b5f187d4-8a09-44d3-a526-f598c0f8cb13 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:33.299283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b5f187d4-8a09-44d3-a526-f598c0f8cb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:33.307780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 24 06:36:33.574009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793983d-bb39-43b0-a8eb-8dd0a4cf399a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:33.586828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793983d-bb39-43b0-a8eb-8dd0a4cf399a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:33.591126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba70fc-b5ce-4972-b635-f85afb8ea7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:33.591730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba70fc-b5ce-4972-b635-f85afb8ea7b3 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:33.592014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba70fc-b5ce-4972-b635-f85afb8ea7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:33.592293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba70fc-b5ce-4972-b635-f85afb8ea7b3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:33.600493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba70fc-b5ce-4972-b635-f85afb8ea7b3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:33.602280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba70fc-b5ce-4972-b635-f85afb8ea7b3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:33.610989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Wed Aug 24 06:36:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:36:33.617163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f187d4-8a09-44d3-a526-f598c0f8cb13 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:33.626272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f187d4-8a09-44d3-a526-f598c0f8cb13 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:33.630651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dedd2e-bd85-4f3b-a11f-70c69e1bff71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:33.631312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedd2e-bd85-4f3b-a11f-70c69e1bff71 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:33.631595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedd2e-bd85-4f3b-a11f-70c69e1bff71 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:33.631869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dedd2e-bd85-4f3b-a11f-70c69e1bff71 admin admin] PATH_INFO: `/v3/users/6fcbd85e11364a39a93fb2a7be48da77` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:33.633173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dedd2e-bd85-4f3b-a11f-70c69e1bff71 admin admin] RBAC: Authorizing `identity:get_user(user_id=6fcbd85e11364a39a93fb2a7be48da77)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:33.635071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dedd2e-bd85-4f3b-a11f-70c69e1bff71 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:33.636585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Wed Aug 24 06:36:33 2022] GET /identity/v3/users/6fcbd85e11364a39a93fb2a7be48da77 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:35.644239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756138e-44de-4636-a06e-317c29dd704c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:35.644770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756138e-44de-4636-a06e-317c29dd704c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:35.644896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c756138e-44de-4636-a06e-317c29dd704c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:35.646731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:35.653578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d64a18-7b83-4dfb-b380-05ad811cd821 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:35.654079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d64a18-7b83-4dfb-b380-05ad811cd821 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:35.654253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d64a18-7b83-4dfb-b380-05ad811cd821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:35.670206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa5ba-2427-44f6-9c0d-ce9362439c86 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:35.670494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa5ba-2427-44f6-9c0d-ce9362439c86 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:35.670817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa5ba-2427-44f6-9c0d-ce9362439c86 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:35.672182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:36:35.675400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-36d64a18-7b83-4dfb-b380-05ad811cd821 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:35.675400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-36d64a18-7b83-4dfb-b380-05ad811cd821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:35.679100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:35.679532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:35.679818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:35.723430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG passlib.handlers.bcrypt [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=93391) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 24 06:36:35.723858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG passlib.handlers.bcrypt [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=93391) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 24 06:36:35.766257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:36:35.769382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:35.771060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:35.871684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:36:36.033803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d64a18-7b83-4dfb-b380-05ad811cd821 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.058206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.137179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.137945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d64a18-7b83-4dfb-b380-05ad811cd821 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.172030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d25393-6784-4323-a504-483180b823ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.172673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25393-6784-4323-a504-483180b823ec None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.172961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25393-6784-4323-a504-483180b823ec None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.173245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d25393-6784-4323-a504-483180b823ec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.185358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d25393-6784-4323-a504-483180b823ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d7d25393-6784-4323-a504-483180b823ec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:36.193923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:36.195072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:36.195899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:36.202786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d25393-6784-4323-a504-483180b823ec None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.241207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e9ea-15b3-4f9f-a83e-15fc1268b854 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.243522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.281450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.282407 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.282598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.282921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.298817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.317624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d25393-6784-4323-a504-483180b823ec None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.351939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.353176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.353176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.353176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.353615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:36.353758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:36.354067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:36.355205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:36.355491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:36.368569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:36.374025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.456702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:36.462448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.465485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.480714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66476ea3-cf55-405f-bd37-298821a4df59 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.516573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.517226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.517516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.517793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] PATH_INFO: `/v3/users/6fcbd85e11364a39a93fb2a7be48da77` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.519010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcbd85e11364a39a93fb2a7be48da77)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:36.520582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:36.522189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/users/6fcbd85e11364a39a93fb2a7be48da77 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:36.528055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.544206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.569419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ed323-bf3f-4fbf-ba6b-c18b34b2a492 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.606074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.606973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.607262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.607534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.627492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:36.628987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:36.639197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919299f7-3990-4cbc-ae9b-99a0f4b511b0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:36:36.647680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:36.649078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:36:36.649869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:36:36.649869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:36:36.649869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:36:36.649869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 9/18] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:36:36.654607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.682201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.682889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.683190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.683461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.684620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:36.686100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:36.687726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 10/19] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:36.693666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:36.717007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.763527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b288d3-f19a-49c5-a14c-0a31175a908a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.777984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:36.799665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08aebe-e53f-4cfd-846b-77131134cdba None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:36.800923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24424245-a89a-4055-9631-a743931a056c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.801541 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424245-a89a-4055-9631-a743931a056c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.801821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424245-a89a-4055-9631-a743931a056c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.802098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24424245-a89a-4055-9631-a743931a056c None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.802747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424245-a89a-4055-9631-a743931a056c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:36.803083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424245-a89a-4055-9631-a743931a056c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:36.805039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24424245-a89a-4055-9631-a743931a056c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:36.824008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 10/20] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:36.836364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a321eb-b448-4dca-8a18-c840d5a11828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:36.836956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a321eb-b448-4dca-8a18-c840d5a11828 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:36.837231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a321eb-b448-4dca-8a18-c840d5a11828 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:36.837529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a321eb-b448-4dca-8a18-c840d5a11828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:36.838433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a321eb-b448-4dca-8a18-c840d5a11828 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.domain.id=default, user.id=6fcbd85e11364a39a93fb2a7be48da77) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:36.838919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a321eb-b448-4dca-8a18-c840d5a11828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:36.840281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a321eb-b448-4dca-8a18-c840d5a11828 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:36.848158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 11/21] 10.222.0.59 () {56 vars in 1322 bytes} [Wed Aug 24 06:36:36 2022] GET /identity/v3/role_assignments?user.id=6fcbd85e11364a39a93fb2a7be48da77&scope.domain.id=default&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 233 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:39.017572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fbb76-0cc5-444b-8bbb-d68d352e781c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.018065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fbb76-0cc5-444b-8bbb-d68d352e781c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.018065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8fbb76-0cc5-444b-8bbb-d68d352e781c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.019721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 11/22] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:39.024903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7409-2641-4092-96c6-8c9cd6b04563 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.025304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7409-2641-4092-96c6-8c9cd6b04563 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.025466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6c7409-2641-4092-96c6-8c9cd6b04563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.051896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9e6c7409-2641-4092-96c6-8c9cd6b04563 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:39.053131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9e6c7409-2641-4092-96c6-8c9cd6b04563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:39.140199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:39.250736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c3a4a-520b-435f-a2fe-8aeac3167f59 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.251095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c3a4a-520b-435f-a2fe-8aeac3167f59 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.251341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8c3a4a-520b-435f-a2fe-8aeac3167f59 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.253017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 12/24] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:39.258511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be775-79a1-4ee5-bb93-b7a07e69a14f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.259122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be775-79a1-4ee5-bb93-b7a07e69a14f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.259600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706be775-79a1-4ee5-bb93-b7a07e69a14f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.287954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-706be775-79a1-4ee5-bb93-b7a07e69a14f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:39.289266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-706be775-79a1-4ee5-bb93-b7a07e69a14f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:39.380611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:39.425224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548bdc4-bf08-4d98-8e89-23dbf2742ca5 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.425941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548bdc4-bf08-4d98-8e89-23dbf2742ca5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.426426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548bdc4-bf08-4d98-8e89-23dbf2742ca5 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.427998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 13/26] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:39.440578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11b30-a12a-4e21-9738-5ba716a7f5ff None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.440860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11b30-a12a-4e21-9738-5ba716a7f5ff None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.441678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c11b30-a12a-4e21-9738-5ba716a7f5ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.451292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:39.467177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-79c11b30-a12a-4e21-9738-5ba716a7f5ff None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:39.468493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-79c11b30-a12a-4e21-9738-5ba716a7f5ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:39.556409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 14/27] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:39.636003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548bdc4-bf08-4d98-8e89-23dbf2742ca5 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:39.791681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548bdc4-bf08-4d98-8e89-23dbf2742ca5 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:39.819202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:39.844020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a547b232-192d-4571-9154-6b11caadaac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:39.844677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547b232-192d-4571-9154-6b11caadaac7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.844966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547b232-192d-4571-9154-6b11caadaac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.845245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a547b232-192d-4571-9154-6b11caadaac7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.858850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c11b30-a12a-4e21-9738-5ba716a7f5ff None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:39.870717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a547b232-192d-4571-9154-6b11caadaac7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-a547b232-192d-4571-9154-6b11caadaac7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:39.886221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:39.887162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:39.888001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:36:39.899060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 14/28] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:36:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:39.900483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d537e4-a960-4bae-86d6-70ad4cf463b3 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.900780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d537e4-a960-4bae-86d6-70ad4cf463b3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.901062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d537e4-a960-4bae-86d6-70ad4cf463b3 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.902386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 15/29] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:39.908477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358046-f29a-4d40-a9df-7d7d6cbf43b6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:39.908764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358046-f29a-4d40-a9df-7d7d6cbf43b6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:39.909047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66358046-f29a-4d40-a9df-7d7d6cbf43b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:39.939307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-66358046-f29a-4d40-a9df-7d7d6cbf43b6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:39.940903 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-66358046-f29a-4d40-a9df-7d7d6cbf43b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:40.025448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 16/30] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:40.026052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c11b30-a12a-4e21-9738-5ba716a7f5ff None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:40.027668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66358046-f29a-4d40-a9df-7d7d6cbf43b6 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:40.063447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:40.064351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.064783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.065253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.068243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:40.090393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:40.092225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:36:40.126874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:40.127810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:36:40.128698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:36:40.128698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:36:40.128698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:40.130614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 15/31] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:36:40.131764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:40.144712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66358046-f29a-4d40-a9df-7d7d6cbf43b6 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:40.186804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:40.188319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:40.188950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.189237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.189515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.190191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:40.190498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:40.191996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:40.218649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 17/32] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:40.219855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:40.286522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8214ccb-29bc-42b3-9227-fb830228fc05 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:40.327412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:40.328053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.328335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.328609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.329755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:40.331473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:40.395123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d14641e-70cd-41bf-9aee-1e6dbe859aa8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:40.442300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:40.443216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.443676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.443964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.444641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:40.445011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:40.446678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:40.463280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 18/33] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:36:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:40.464224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:40.497544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:40.568753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 16/34] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 06:36:40 2022] POST /identity/v3/roles => generated 219 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:40.570381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:40.617453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154858dc-3677-4f37-9bd7-ecc26f1a0aa0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:40.666439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:40.731096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:40.732192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.732711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.733194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] PATH_INFO: `/v3/users/6fcbd85e11364a39a93fb2a7be48da77` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.736025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcbd85e11364a39a93fb2a7be48da77)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:40.738929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:40.742357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 19/35] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:40 2022] GET /identity/v3/users/6fcbd85e11364a39a93fb2a7be48da77 => generated 247 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:40.748001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:40.750574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8425cec-9f8b-4d5c-a17f-47e3b438b819 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:40.799307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b5220-1a26-44e5-b402-3a2bb9cfc81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:40.800887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5220-1a26-44e5-b402-3a2bb9cfc81a None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.801471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5220-1a26-44e5-b402-3a2bb9cfc81a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.801964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b5220-1a26-44e5-b402-3a2bb9cfc81a None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.802991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5220-1a26-44e5-b402-3a2bb9cfc81a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:40.804854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6b5220-1a26-44e5-b402-3a2bb9cfc81a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:40.870593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:40.874687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 17/36] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 06:36:40 2022] POST /identity/v3/roles => generated 225 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:40.876038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ef00-bfe8-4a40-836a-d2816a36e70b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.876408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ef00-bfe8-4a40-836a-d2816a36e70b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.876695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c2ef00-bfe8-4a40-836a-d2816a36e70b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.877168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9c2510-2e35-4868-a8a6-df29e91b47c5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:40.878036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 18/37] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:40.887338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2ef00-bfe8-4a40-836a-d2816a36e70b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:40.929193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bd1756-4a2d-4d48-8330-1790d3b2f853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:40.929662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd1756-4a2d-4d48-8330-1790d3b2f853 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:40.930003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd1756-4a2d-4d48-8330-1790d3b2f853 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:40.930284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bd1756-4a2d-4d48-8330-1790d3b2f853 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:40.931008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd1756-4a2d-4d48-8330-1790d3b2f853 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:40.932761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bd1756-4a2d-4d48-8330-1790d3b2f853 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:41.023839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c2ef00-bfe8-4a40-836a-d2816a36e70b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:41.032681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:41.060838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e08a7f-0441-467b-8e91-a1da4b1463dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:41.061492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e08a7f-0441-467b-8e91-a1da4b1463dd None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:41.061774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e08a7f-0441-467b-8e91-a1da4b1463dd None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:41.062107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e08a7f-0441-467b-8e91-a1da4b1463dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:41.063374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e08a7f-0441-467b-8e91-a1da4b1463dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:41.064832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e08a7f-0441-467b-8e91-a1da4b1463dd None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:41.070955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 19/38] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:41.072280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054023-1791-4a64-b8f1-45cbdce439d2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:41.072597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054023-1791-4a64-b8f1-45cbdce439d2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:41.072907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40054023-1791-4a64-b8f1-45cbdce439d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:41.093146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-40054023-1791-4a64-b8f1-45cbdce439d2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:41.094708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-40054023-1791-4a64-b8f1-45cbdce439d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:41.136761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 20/39] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:36:40 2022] POST /identity/v3/projects => generated 301 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:41.138325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20ab2f-aae4-4ab4-b97c-7a11e943acef None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:41.138624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20ab2f-aae4-4ab4-b97c-7a11e943acef None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:41.138943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b20ab2f-aae4-4ab4-b97c-7a11e943acef None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:41.140610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 21/40] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:41.145867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20ab2f-aae4-4ab4-b97c-7a11e943acef None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:41.272789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b20ab2f-aae4-4ab4-b97c-7a11e943acef None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:41.289927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 20/41] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:41.289927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017546e9-285c-4836-9903-52a0241319f0 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:41.289927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017546e9-285c-4836-9903-52a0241319f0 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:41.289927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017546e9-285c-4836-9903-52a0241319f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:41.307567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-017546e9-285c-4836-9903-52a0241319f0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:41.308787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-017546e9-285c-4836-9903-52a0241319f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:41.321294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:41.321990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:41.322278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:41.322565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] PATH_INFO: `/v3/domains/default/users/6fcbd85e11364a39a93fb2a7be48da77/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:41.324768 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6fcbd85e11364a39a93fb2a7be48da77, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:41.326350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:41.387478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 21/42] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:41.430618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 22/43] 10.222.0.59 () {58 vars in 1361 bytes} [Wed Aug 24 06:36:41 2022] PUT /identity/v3/domains/default/users/6fcbd85e11364a39a93fb2a7be48da77/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:36:41.558249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017546e9-285c-4836-9903-52a0241319f0 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:41.594581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:41.664845 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:41.676665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017546e9-285c-4836-9903-52a0241319f0 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:41.677574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:41.732918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:41.733614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:41.733866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:41.734195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:41.734877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:41.736296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:41.783867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e00b580-f886-4edb-8eb5-b874619858cf None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:41.816902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 22/44] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 06:36:41 2022] POST /identity/v3/roles => generated 223 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:41.823119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ff538-ffee-4724-b43a-f2b7fd6056f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:41.823861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff538-ffee-4724-b43a-f2b7fd6056f4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:41.824154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff538-ffee-4724-b43a-f2b7fd6056f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:41.824595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ff538-ffee-4724-b43a-f2b7fd6056f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:41.825798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff538-ffee-4724-b43a-f2b7fd6056f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:41.827456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ff538-ffee-4724-b43a-f2b7fd6056f4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:41.829623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 23/45] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:41.836077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:41.991884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:41.998947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db650f-ab05-412a-ae4b-b841bc8f0bbd None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:42.044682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be18d6b8-c119-459b-b609-98428a04504c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:42.045328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d6b8-c119-459b-b609-98428a04504c None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:42.045617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d6b8-c119-459b-b609-98428a04504c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:42.045894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be18d6b8-c119-459b-b609-98428a04504c None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:42.046571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d6b8-c119-459b-b609-98428a04504c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:42.048126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be18d6b8-c119-459b-b609-98428a04504c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:42.142072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 23/46] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:36:41 2022] POST /identity/v3/projects => generated 312 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:43.367629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8db1-41af-408d-afe1-cb7fb5832265 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:43.368152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8db1-41af-408d-afe1-cb7fb5832265 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:43.368233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cae8db1-41af-408d-afe1-cb7fb5832265 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:43.369698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 24/47] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:43.375977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d3231-b7a9-4695-ad00-80e688f1d4fa None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:43.376399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d3231-b7a9-4695-ad00-80e688f1d4fa None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:43.376548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d3231-b7a9-4695-ad00-80e688f1d4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:43.395318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-524d3231-b7a9-4695-ad00-80e688f1d4fa None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:43.396550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-524d3231-b7a9-4695-ad00-80e688f1d4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:43.464725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 24/48] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:43.735887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae8db1-41af-408d-afe1-cb7fb5832265 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:43.816257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:43.839786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cae8db1-41af-408d-afe1-cb7fb5832265 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:43.875231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:43.875933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:43.876222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:43.876552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:43.887634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:43.892902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:43.894482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:36:43.895454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 25/49] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:36:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:43.900488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d3231-b7a9-4695-ad00-80e688f1d4fa None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:43.980614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:44.002582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d3231-b7a9-4695-ad00-80e688f1d4fa None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:44.038264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8639d2be-7df5-4b20-9193-44f99e829eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:44.038917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d2be-7df5-4b20-9193-44f99e829eb4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.039207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d2be-7df5-4b20-9193-44f99e829eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.039495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8639d2be-7df5-4b20-9193-44f99e829eb4 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.040169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d2be-7df5-4b20-9193-44f99e829eb4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:44.040479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d2be-7df5-4b20-9193-44f99e829eb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:44.041879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8639d2be-7df5-4b20-9193-44f99e829eb4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:44.050261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 25/50] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:44.055946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:44.057642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef79f9e-5dbc-4a16-a332-22e8eb5400c8 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.057938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef79f9e-5dbc-4a16-a332-22e8eb5400c8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.058227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef79f9e-5dbc-4a16-a332-22e8eb5400c8 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.059574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 26/51] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:36:44.064592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072275f4-ca66-490d-8367-ed81f92811b3 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.064889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072275f4-ca66-490d-8367-ed81f92811b3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.065179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072275f4-ca66-490d-8367-ed81f92811b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.084487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-072275f4-ca66-490d-8367-ed81f92811b3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:44.085795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-072275f4-ca66-490d-8367-ed81f92811b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:44.154401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 27/52] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:36:44.159048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378c40-44cf-4dc9-8579-2d88b53b8903 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:44.193610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:44.194246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.194534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.194842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] PATH_INFO: `/v3/users/6fcbd85e11364a39a93fb2a7be48da77` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.196007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcbd85e11364a39a93fb2a7be48da77)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:44.197483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:44.199111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:44 2022] GET /identity/v3/users/6fcbd85e11364a39a93fb2a7be48da77 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:44.204668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072275f4-ca66-490d-8367-ed81f92811b3 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:44.273104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:44.308206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072275f4-ca66-490d-8367-ed81f92811b3 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:44.343075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:44.343736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.344022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.344299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.345434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:44.346942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:44.348601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 28/54] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:44.354442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:44.358309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:44.422422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:44.461342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d78bd49-675d-4d0e-87bc-2ad149eafa17 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:44.495224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:44.495931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.496226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.496513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.497252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.domain.id=default, user.id=6fcbd85e11364a39a93fb2a7be48da77) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:44.497566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:44.499061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:44.507689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1322 bytes} [Wed Aug 24 06:36:44 2022] GET /identity/v3/role_assignments?user.id=6fcbd85e11364a39a93fb2a7be48da77&scope.domain.id=default&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 530 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:44.529853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5342945-304f-46aa-adf8-a5ece6c6a631 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:44.570843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd792a1-a6d7-4c7d-9ada-4accc527bf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:44.571512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd792a1-a6d7-4c7d-9ada-4accc527bf4a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.571803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd792a1-a6d7-4c7d-9ada-4accc527bf4a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.572091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd792a1-a6d7-4c7d-9ada-4accc527bf4a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.573374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd792a1-a6d7-4c7d-9ada-4accc527bf4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:44.574924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd792a1-a6d7-4c7d-9ada-4accc527bf4a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:44.576635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 29/56] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:44.582703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:44.656581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:44.693394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94226ed-b78b-46c2-8028-5be31ffb82ab None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:44.738712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13c4fde-a15e-405b-ad3c-92626f440e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:44.739439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4fde-a15e-405b-ad3c-92626f440e0f None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:44.739756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4fde-a15e-405b-ad3c-92626f440e0f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:44.740107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13c4fde-a15e-405b-ad3c-92626f440e0f None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:44.741032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4fde-a15e-405b-ad3c-92626f440e0f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:44.742813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13c4fde-a15e-405b-ad3c-92626f440e0f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:44.886940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 28/57] 10.222.0.59 () {60 vars in 1140 bytes} [Wed Aug 24 06:36:44 2022] POST /identity/v3/projects => generated 298 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:46.803187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9aa7d-6eaa-4049-83ba-76888a16a13d None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:46.803704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9aa7d-6eaa-4049-83ba-76888a16a13d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:46.803790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9aa7d-6eaa-4049-83ba-76888a16a13d None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:46.805109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 30/58] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:46.811077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6e4b-dd07-4036-83f5-ac08aba77546 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:46.811563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6e4b-dd07-4036-83f5-ac08aba77546 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:46.811649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc6e4b-dd07-4036-83f5-ac08aba77546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:46.935075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7bcc6e4b-dd07-4036-83f5-ac08aba77546 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:46.936635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7bcc6e4b-dd07-4036-83f5-ac08aba77546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:47.001796 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 29/59] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:47.275283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9aa7d-6eaa-4049-83ba-76888a16a13d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:47.279054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:47.375656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9aa7d-6eaa-4049-83ba-76888a16a13d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:47.407862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabbf28-fca1-4e56-a039-4d4989d05a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:47.408497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbf28-fca1-4e56-a039-4d4989d05a49 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:47.408784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbf28-fca1-4e56-a039-4d4989d05a49 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:47.409064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabbf28-fca1-4e56-a039-4d4989d05a49 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:47.410218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabbf28-fca1-4e56-a039-4d4989d05a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:47.411716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabbf28-fca1-4e56-a039-4d4989d05a49 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:47.413290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 31/60] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:47.418847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6e4b-dd07-4036-83f5-ac08aba77546 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:47.467574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:47.516513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc6e4b-dd07-4036-83f5-ac08aba77546 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:47.549600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46f1b58-a05d-4bad-98f6-e79e1aef83b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:47.550210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1b58-a05d-4bad-98f6-e79e1aef83b2 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:47.551002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1b58-a05d-4bad-98f6-e79e1aef83b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:47.551288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46f1b58-a05d-4bad-98f6-e79e1aef83b2 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:47.551949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1b58-a05d-4bad-98f6-e79e1aef83b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:47.553421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46f1b58-a05d-4bad-98f6-e79e1aef83b2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:47.648901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 30/61] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:36:47 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:50.589992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3ea8-71e0-49a5-99b4-7e14b9f72b47 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:50.590536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3ea8-71e0-49a5-99b4-7e14b9f72b47 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:50.590536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d3ea8-71e0-49a5-99b4-7e14b9f72b47 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:50.591921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 32/62] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:50.597854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d70c-e24f-4b81-ba7d-091eaaa38b69 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:50.598619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d70c-e24f-4b81-ba7d-091eaaa38b69 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:50.599077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312d70c-e24f-4b81-ba7d-091eaaa38b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:50.622293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1312d70c-e24f-4b81-ba7d-091eaaa38b69 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:50.623744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1312d70c-e24f-4b81-ba7d-091eaaa38b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:50.718041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 31/63] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:50.842093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6dd6-49d8-4d2c-92bc-5eeeb0fd6ece None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:50.842716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6dd6-49d8-4d2c-92bc-5eeeb0fd6ece None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:50.843217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ae6dd6-49d8-4d2c-92bc-5eeeb0fd6ece None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:50.845033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 33/64] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:50.850233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274afed-d1c3-4c4b-a8cc-a513dc3a1d91 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:50.850530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274afed-d1c3-4c4b-a8cc-a513dc3a1d91 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:50.850847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274afed-d1c3-4c4b-a8cc-a513dc3a1d91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:50.873930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f274afed-d1c3-4c4b-a8cc-a513dc3a1d91 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:50.875353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f274afed-d1c3-4c4b-a8cc-a513dc3a1d91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:50.917148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:50.968132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 32/65] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:50.996308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6dd6-49d8-4d2c-92bc-5eeeb0fd6ece None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.018396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc26193-1363-44ee-921c-e410ec31d766 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.018692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc26193-1363-44ee-921c-e410ec31d766 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.019557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc26193-1363-44ee-921c-e410ec31d766 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.021064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 33/66] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:51.027230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd22b2-c8bf-49b6-9f53-7c2505e282e6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.027517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd22b2-c8bf-49b6-9f53-7c2505e282e6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.027799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dd22b2-c8bf-49b6-9f53-7c2505e282e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.056616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-37dd22b2-c8bf-49b6-9f53-7c2505e282e6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:51.057823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-37dd22b2-c8bf-49b6-9f53-7c2505e282e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:51.125985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:51.164126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ae6dd6-49d8-4d2c-92bc-5eeeb0fd6ece None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.212964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 34/67] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:36:51.232517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.233195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.233486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.233768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.259954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:51.265517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:51.266430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:51.267214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 34/68] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:51.274807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd22b2-c8bf-49b6-9f53-7c2505e282e6 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.284765 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.433524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08701ebe-0441-4b0b-8a55-37ca929ad8be None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.466187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:51.471550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98ff69f-336f-43d3-b213-9b0c98dfb040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.472743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff69f-336f-43d3-b213-9b0c98dfb040 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.473041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff69f-336f-43d3-b213-9b0c98dfb040 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.473354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98ff69f-336f-43d3-b213-9b0c98dfb040 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.477783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:51.483883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dd22b2-c8bf-49b6-9f53-7c2505e282e6 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.486198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98ff69f-336f-43d3-b213-9b0c98dfb040 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d98ff69f-336f-43d3-b213-9b0c98dfb040 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:51.491737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:51.494150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 35/69] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:36:51.496055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ecc3b-d723-42df-a5d9-29e34753fbda None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.498016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ecc3b-d723-42df-a5d9-29e34753fbda None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.498016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4ecc3b-d723-42df-a5d9-29e34753fbda None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.498016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 36/70] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:51.502277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ecc3b-d723-42df-a5d9-29e34753fbda None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.522831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f328424-4bf3-4589-9a4d-7f6665107f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.522831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328424-4bf3-4589-9a4d-7f6665107f32 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.522831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328424-4bf3-4589-9a4d-7f6665107f32 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.523146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f328424-4bf3-4589-9a4d-7f6665107f32 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.523614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f328424-4bf3-4589-9a4d-7f6665107f32 None admin] RBAC: Adding query filter params (name=member) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:51.523921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f328424-4bf3-4589-9a4d-7f6665107f32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:51.525337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f328424-4bf3-4589-9a4d-7f6665107f32 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:51.539167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:51.541315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9c08-c250-4455-abde-b9c6dc065d23 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.541615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9c08-c250-4455-abde-b9c6dc065d23 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.541900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ce9c08-c250-4455-abde-b9c6dc065d23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.567154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f0ce9c08-c250-4455-abde-b9c6dc065d23 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:51.569008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f0ce9c08-c250-4455-abde-b9c6dc065d23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:51.622331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4ecc3b-d723-42df-a5d9-29e34753fbda None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.646746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 36/72] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:51.658584 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.658951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9c08-c250-4455-abde-b9c6dc065d23 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.659233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.659521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.660326 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.661005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:51.661311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:51.662894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:51.672309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 37/73] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:51.673220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.736668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:51.765154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:51.779143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ce9c08-c250-4455-abde-b9c6dc065d23 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.785284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c10a3-9d54-41b1-89c3-c629319bd707 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.817946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.818691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.819013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.819295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.820363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d61e6-459e-45e6-a0b4-2aff6eba077e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.821057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d61e6-459e-45e6-a0b4-2aff6eba077e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.821279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d61e6-459e-45e6-a0b4-2aff6eba077e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.821556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d61e6-459e-45e6-a0b4-2aff6eba077e None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.830112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:51.835872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:51.836936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:36:51.837700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 37/74] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:51.838333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.839098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d61e6-459e-45e6-a0b4-2aff6eba077e None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:51.840733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d61e6-459e-45e6-a0b4-2aff6eba077e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:51.846783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 38/75] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:51.846783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b76a-2101-4d45-81a3-4522af287836 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.846783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b76a-2101-4d45-81a3-4522af287836 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.846783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522b76a-2101-4d45-81a3-4522af287836 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.846783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 39/76] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:51.846783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b76a-2101-4d45-81a3-4522af287836 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.953478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208424fa-09aa-4416-be7c-402531ef9cf6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.956978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522b76a-2101-4d45-81a3-4522af287836 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:51.970028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:51.988409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.989049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.989338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.989615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] PATH_INFO: `/v3/users/6fcbd85e11364a39a93fb2a7be48da77` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.991018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcbd85e11364a39a93fb2a7be48da77)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:51.991821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328293f2-33c7-43d9-9373-adc5924b3d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:51.992437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328293f2-33c7-43d9-9373-adc5924b3d23 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:51.992522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:51.992722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328293f2-33c7-43d9-9373-adc5924b3d23 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:51.993000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328293f2-33c7-43d9-9373-adc5924b3d23 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:51.993670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328293f2-33c7-43d9-9373-adc5924b3d23 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:51.993986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328293f2-33c7-43d9-9373-adc5924b3d23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:51.994175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 38/77] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/users/6fcbd85e11364a39a93fb2a7be48da77 => generated 247 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:51.994966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:51.995395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328293f2-33c7-43d9-9373-adc5924b3d23 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.004612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 40/78] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:52.005847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d6898-d201-4ad2-8059-2f3774de8267 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.006132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d6898-d201-4ad2-8059-2f3774de8267 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.006408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3d6898-d201-4ad2-8059-2f3774de8267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.016706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.025257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3e3d6898-d201-4ad2-8059-2f3774de8267 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:52.028615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3e3d6898-d201-4ad2-8059-2f3774de8267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:52.093952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 41/79] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:52.094844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d6898-d201-4ad2-8059-2f3774de8267 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.112932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392df2ae-7d63-4055-b961-2293066c1cd3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.152313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.152942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.153235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.153523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.199938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3d6898-d201-4ad2-8059-2f3774de8267 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.203696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.227594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.229970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.236320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.237314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.237873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.238536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.249292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.251714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:52.257102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:52.264336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 42/80] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:52.265284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.346017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 39/81] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:36:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:52.347074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.367911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df108795-c47f-40b2-b49c-f0e67d52d91f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.404056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.404675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.404963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.405242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.443192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.450783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58de653-e96b-41de-98a9-a733c80972ce None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.468305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.481875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.483323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.486673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.487289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.487577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.488357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.489567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.491067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.492694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 40/82] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:52.493488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.592384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 43/83] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:52.593488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.603498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee150b6-9b8c-441d-9797-6aa56e002ad8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.649799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.650442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.650700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.651017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.651699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:52.652010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.653418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.657129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.662449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 41/84] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:52.663353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.703429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae0c04-2b50-49e4-94a9-3853447e8b8b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.718881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.738895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.739476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.740363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.740363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.741362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.742901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.744634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 44/85] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:52.745433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.776304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0cbd3b-e4ee-45eb-8124-16e94b6f11c4 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.812171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.812813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.813161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.813449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.814599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.816705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.818309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 42/86] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:52.820214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.853897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f5b8d5-d9e6-4f4a-8d51-c133d51171a3 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.883093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.890122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.890738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.891049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.893712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.921852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f675d580-21e3-44dd-89b0-57ea146cf188 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:52.936005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:52.955898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:52.956539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:52.956821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:52.957104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:52.958276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.959768 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:52.961440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 43/87] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:52.962184 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:52.967637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:52.969238 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.066672 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb87e00-ae16-4215-89cd-1dc21d472d79 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:53.068441 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 45/88] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:53.069298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:53.100194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:53.100825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:53.101105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:53.101388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:53.101548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:53.102556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:53.104017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.105593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 44/89] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:52 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:53.106338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:53.155529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:53.174235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d7dd3e-817c-4207-9988-75e39d978cfe None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:53.207252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d8ff6e-0dfe-4b8f-9823-c7393459cfd0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:53.209758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:53.210029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:53.210315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:53.210595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:53.211391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=e0e17fe7e3984d7f92da9fa6d4676d15) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:53.211704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:53.213225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.218855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 46/90] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:36:53 2022] GET /identity/v3/role_assignments?user.id=e0e17fe7e3984d7f92da9fa6d4676d15&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:53.219670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:53.245665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:53.246295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:53.246584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:53.246892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:53.247566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:53.249068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.337637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:53.344663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1445b763-b27f-4f38-899a-3b527cfb1c4f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:53.345818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 45/91] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:36:53 2022] POST /identity/v3/users => generated 289 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:53.346675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:53.398578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:53.399551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:53.399839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:53.400676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:53.401750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=6fcbd85e11364a39a93fb2a7be48da77) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:53.402075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:53.403947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.412726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 47/92] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:36:53 2022] GET /identity/v3/role_assignments?user.id=6fcbd85e11364a39a93fb2a7be48da77&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:53.413891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:53.557183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572736d-9146-42ae-aae0-20b113d2afb5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:53.566353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05549c1a-df37-48a4-a88e-edbb6bc2aafb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:53.569035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:53.607472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:53.608050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:53.608320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:53.608606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:53.609456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:53.610428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:53.610951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:53.618336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:53.618336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:53.618336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.618336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 46/93] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:53 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:53.622683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:53.643195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:53.690388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:53.694024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.747504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156e22bb-a9cd-4ffa-b2d7-c138994099f0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:53.786228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:53.787335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:53.787831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:53.788315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:53.789263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] RBAC: Adding query filter params (role.id=91979b0781874aef81daab5791316f61, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=e0e17fe7e3984d7f92da9fa6d4676d15) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:53.789784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:53.791526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:53.798579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 47/94] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:36:53 2022] GET /identity/v3/role_assignments?user.id=e0e17fe7e3984d7f92da9fa6d4676d15&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=91979b0781874aef81daab5791316f61 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:53.821507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 48/95] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:36:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:53.827640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:53.913964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:54.002670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e307a53-c8c3-4ea4-821b-27409c476e4b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:54.050902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c2f6f-f4ed-4413-8fdc-21b697cf756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:54.051558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2f6f-f4ed-4413-8fdc-21b697cf756b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:54.051849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2f6f-f4ed-4413-8fdc-21b697cf756b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:54.052133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c2f6f-f4ed-4413-8fdc-21b697cf756b None admin] PATH_INFO: `/v3/projects/f75ee7c710fa475cbce6e47ee28d0279` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:54.053310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c2f6f-f4ed-4413-8fdc-21b697cf756b None admin] RBAC: Authorizing `identity:get_project(project_id=f75ee7c710fa475cbce6e47ee28d0279)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:54.054807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c2f6f-f4ed-4413-8fdc-21b697cf756b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:54.056489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 48/96] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:53 2022] GET /identity/v3/projects/f75ee7c710fa475cbce6e47ee28d0279 => generated 312 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:54.062454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:54.125602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:54.170701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a12b3-76da-40b1-ac2c-530cb0ebdab8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:54.211085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d1bcef-4664-43f8-abbd-047081ecc1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:54.212010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1bcef-4664-43f8-abbd-047081ecc1ac None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:54.212316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1bcef-4664-43f8-abbd-047081ecc1ac None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:54.212601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d1bcef-4664-43f8-abbd-047081ecc1ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:54.213353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1bcef-4664-43f8-abbd-047081ecc1ac None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=f75ee7c710fa475cbce6e47ee28d0279, user.id=e0e17fe7e3984d7f92da9fa6d4676d15) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:54.213671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1bcef-4664-43f8-abbd-047081ecc1ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:54.215176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d1bcef-4664-43f8-abbd-047081ecc1ac None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:54.221102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 49/97] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:36:54 2022] GET /identity/v3/role_assignments?user.id=e0e17fe7e3984d7f92da9fa6d4676d15&scope.project.id=f75ee7c710fa475cbce6e47ee28d0279&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:56.016332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b17c7b-630a-4778-9a07-2936ac45cde9 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.016809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b17c7b-630a-4778-9a07-2936ac45cde9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.016809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b17c7b-630a-4778-9a07-2936ac45cde9 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.018338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 49/98] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:56.025491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9d50-9fa7-45db-9800-7bf56e502d28 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.025966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9d50-9fa7-45db-9800-7bf56e502d28 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.026037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c9d50-9fa7-45db-9800-7bf56e502d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.051799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-e55c9d50-9fa7-45db-9800-7bf56e502d28 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:56.053145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e55c9d50-9fa7-45db-9800-7bf56e502d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:56.145884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 50/99] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:56.257402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92bcbd-55d6-45c6-9990-87652c02f5c0 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.258061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92bcbd-55d6-45c6-9990-87652c02f5c0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.258549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a92bcbd-55d6-45c6-9990-87652c02f5c0 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.260262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 50/100] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:56.266527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae744-8817-44c2-a44b-8f3c3a2b5f08 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.267202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae744-8817-44c2-a44b-8f3c3a2b5f08 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.267680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ae744-8817-44c2-a44b-8f3c3a2b5f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.291676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d50ae744-8817-44c2-a44b-8f3c3a2b5f08 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:56.293952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d50ae744-8817-44c2-a44b-8f3c3a2b5f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:56.360628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:56.380658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 51/101] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:56.427965 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feae79-bc45-4442-90e8-3c0c9cf2b70f None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.428606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feae79-bc45-4442-90e8-3c0c9cf2b70f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.429080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73feae79-bc45-4442-90e8-3c0c9cf2b70f None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.430644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 51/102] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:56.436365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058878fc-c3e2-456e-ad6d-77d63c2cefae None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.436918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058878fc-c3e2-456e-ad6d-77d63c2cefae None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.437391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058878fc-c3e2-456e-ad6d-77d63c2cefae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.464744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-058878fc-c3e2-456e-ad6d-77d63c2cefae None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:56.466277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-058878fc-c3e2-456e-ad6d-77d63c2cefae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:56.540733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 52/103] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:56.592573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c903-c36f-4c6c-b0e1-7fe31672e521 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.592871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c903-c36f-4c6c-b0e1-7fe31672e521 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.593136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f0c903-c36f-4c6c-b0e1-7fe31672e521 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.594807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 52/104] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:56.600652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80dd9-c79f-4ca2-b6dc-266b2e8affed None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.600941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80dd9-c79f-4ca2-b6dc-266b2e8affed None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.601220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef80dd9-c79f-4ca2-b6dc-266b2e8affed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.626691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-eef80dd9-c79f-4ca2-b6dc-266b2e8affed None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:56.627926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-eef80dd9-c79f-4ca2-b6dc-266b2e8affed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:56.631461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c903-c36f-4c6c-b0e1-7fe31672e521 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:56.765199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f0c903-c36f-4c6c-b0e1-7fe31672e521 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:56.787132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:56.790025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 53/105] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:56.791807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef80dd9-c79f-4ca2-b6dc-266b2e8affed None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:56.840506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:56.841244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:56.841504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:56.841992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:56.871203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:56.882555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:56.883474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:36:56.884224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 53/106] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:36:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:36:56.903189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:56.904450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.040348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c787c29c-eaae-47f5-bc4f-9da94e68fa90 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.041004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef80dd9-c79f-4ca2-b6dc-266b2e8affed None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.102712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.103586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.105102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.106036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.107353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:57.108263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:57.110177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:57.111758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.112446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.112737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.113019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.122177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 54/107] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:36:57.123338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.132056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:57.138420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:57.139462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:57.140216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 54/108] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:36:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:57.140831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.164165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:57.245712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7199dd-b8b7-4c6d-a188-ab6449e8f54a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.256938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e9b2-a3cb-4cdb-ae20-782a2bc2c210 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.260735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:57.284191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.284853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.285147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.285423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.297626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:57.298975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.299624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.300430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.300709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:57.302981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:57.303926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:36:57.304713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 55/109] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:57.305337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.317333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:57.322142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:57.323104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:57.324025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 55/110] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:57.324938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.408412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:57.423882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9194a4aa-82e7-4ea5-b3c0-875a3157e72d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.438016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e11e49-4d4c-4cf6-87fa-4a0f7b0897d8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.467823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e006f-cec7-4a14-9be4-024adc0bc90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.468474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e006f-cec7-4a14-9be4-024adc0bc90b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.468763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e006f-cec7-4a14-9be4-024adc0bc90b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.469051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e006f-cec7-4a14-9be4-024adc0bc90b None admin] PATH_INFO: `/v3/users/6fcbd85e11364a39a93fb2a7be48da77` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.470219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e006f-cec7-4a14-9be4-024adc0bc90b None admin] RBAC: Authorizing `identity:get_user(user_id=6fcbd85e11364a39a93fb2a7be48da77)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:57.472265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e006f-cec7-4a14-9be4-024adc0bc90b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:57.473910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 56/111] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/users/6fcbd85e11364a39a93fb2a7be48da77 => generated 247 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:57.474150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.474790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.475089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.475179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1100ad-fc02-4aa2-b295-f5fd3ea57b7e None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.475376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.475463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1100ad-fc02-4aa2-b295-f5fd3ea57b7e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.475716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1100ad-fc02-4aa2-b295-f5fd3ea57b7e None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.476059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:57.476370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:57.477131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 57/112] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:57.477992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4849c1d-18fe-4bbd-8626-36093a7aebad None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.478300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4849c1d-18fe-4bbd-8626-36093a7aebad None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.478701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4849c1d-18fe-4bbd-8626-36093a7aebad None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.479947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 58/113] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:36:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:36:57.480505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4849c1d-18fe-4bbd-8626-36093a7aebad None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.481778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:57.491706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 56/114] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:57.492220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.521356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:57.591823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4849c1d-18fe-4bbd-8626-36093a7aebad None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.596329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce6cc3d-3cc1-41e5-8ffe-acdffe045055 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.629495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.630118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.630404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.630693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.631481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] RBAC: Adding query filter params (name=reader) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:57.631793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:57.633189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:57.633365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df94195f-ca12-4dd6-8e82-a74b4a5d8533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.633983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94195f-ca12-4dd6-8e82-a74b4a5d8533 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.634271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94195f-ca12-4dd6-8e82-a74b4a5d8533 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.634553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df94195f-ca12-4dd6-8e82-a74b4a5d8533 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.635247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94195f-ca12-4dd6-8e82-a74b4a5d8533 None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:57.635645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94195f-ca12-4dd6-8e82-a74b4a5d8533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:57.637015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df94195f-ca12-4dd6-8e82-a74b4a5d8533 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:57.642048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 59/115] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:57.642947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.654242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 57/116] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:57.654242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce878c-288b-4ae6-8b29-9aa4938e128f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.654242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce878c-288b-4ae6-8b29-9aa4938e128f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.654242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce878c-288b-4ae6-8b29-9aa4938e128f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.662974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:57.671237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-74ce878c-288b-4ae6-8b29-9aa4938e128f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:57.672472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-74ce878c-288b-4ae6-8b29-9aa4938e128f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:57.742430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 58/117] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:57.743967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c227bc-ee30-4624-803e-3ccc6dac2134 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.744307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c227bc-ee30-4624-803e-3ccc6dac2134 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.744590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c227bc-ee30-4624-803e-3ccc6dac2134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.749666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d32c97-589e-40ae-a2a6-bac4249b4afb None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.761923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-31c227bc-ee30-4624-803e-3ccc6dac2134 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:36:57.763173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-31c227bc-ee30-4624-803e-3ccc6dac2134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:36:57.778618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:57.790468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.791148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.791439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.791711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.792853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:57.794565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:57.796477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 60/118] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:57.797061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.839022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 59/119] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:36:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:36:57.840205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c227bc-ee30-4624-803e-3ccc6dac2134 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.913429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:57.934307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd39651-685f-4e33-bf1d-f28650d8bb73 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.951077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c227bc-ee30-4624-803e-3ccc6dac2134 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:57.982901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.983612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.984217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.984508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:57.986177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:57.988008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:57.989643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 61/120] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:57.990430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:57.991521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:57.992415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:57.992901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:57.993404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] PATH_INFO: `/v3/users/d75044eac6cd467ab9d7537817a5d5e2` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.014924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] RBAC: Authorizing `identity:get_user(user_id=d75044eac6cd467ab9d7537817a5d5e2)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.017308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.019753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 60/121] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/users/d75044eac6cd467ab9d7537817a5d5e2 => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:58.020469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.030228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:58.119107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac7fd1e-644c-44d2-81bd-47520b5f35af None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.134822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7673a5f-c03a-458f-b3fc-aa60d849a4ce None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.154420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.155093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.155378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.155665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.156801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.158290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.159953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 62/122] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:57 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:58.160723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.171292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.171898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.172187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.172470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/6fcbd85e11364a39a93fb2a7be48da77/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.174449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] RBAC: Authorizing `identity:create_grant(project_id=433dd2d3979a4228bf1eaa4d46e7a74a, user_id=6fcbd85e11364a39a93fb2a7be48da77, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.175974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.183935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:58.256518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e1b90a-4bc1-4501-9329-9b225a2a6be1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.264916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 61/123] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:36:58 2022] PUT /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/6fcbd85e11364a39a93fb2a7be48da77/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:36:58.278182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.294039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.294991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.295279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.295556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.296928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.298592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.305638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 63/124] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:58 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:58.305638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.355325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:58.404098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661b9ec-f73f-40fc-b61f-7e28bd632454 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.418899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:58.430972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82a5f4d-4b4c-4aa6-9e80-87f1945a591b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.450997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.451720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.452012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.452295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.464950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:36:58.470410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:36:58.471443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:36:58.472296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 62/125] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:36:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:36:58.473138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.478656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.479348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.479643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.479930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.566795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.568296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.610248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edf142-ffe8-4874-9f07-ecfa72dc6048 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.642808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:58.652221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.652898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.653187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.653470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.654755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.656409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.658827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 63/126] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:36:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:58.659609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.673738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:58.692005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 64/127] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:36:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:36:58.692005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.801249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff8d62-d414-42d6-941b-a5ced367052a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.808617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbf27c-3c4a-4117-b2b6-6e850831f3f6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:58.840586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.841321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.841605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.841884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.843048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.844521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.847095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 64/128] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:58 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:58.847641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.853288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:58.853973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:58.854262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:58.854545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/e0e17fe7e3984d7f92da9fa6d4676d15/roles/91979b0781874aef81daab5791316f61` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:58.856770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] RBAC: Authorizing `identity:create_grant(project_id=433dd2d3979a4228bf1eaa4d46e7a74a, user_id=e0e17fe7e3984d7f92da9fa6d4676d15, role_id=91979b0781874aef81daab5791316f61)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:58.858227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:58.913023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:58.945286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 65/129] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:36:58 2022] PUT /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/e0e17fe7e3984d7f92da9fa6d4676d15/roles/91979b0781874aef81daab5791316f61 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:36:58.946072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:58.964873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62c2ed1-dfc1-4279-9ee8-bdb61da34424 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:59.009743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:59.010728 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:59.011187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:59.014394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:59.017338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:59.017859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:59.019716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:59.021053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:59.030715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 65/130] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:36:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:59.032111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:59.093380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad17fca-5cfe-41ea-beac-9c7c8528e834 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:59.143908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:59.144557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:59.144810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:59.145093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:59.145764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:59.147279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:59.168560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc722b2f-72aa-466b-bd72-9c3731586633 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:59.201657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:59.213319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:59.214284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:59.214746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:59.215290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:59.216670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:59.218461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:59.220485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 66/131] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:59 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:59.221465 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:59.243083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 66/132] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:36:58 2022] POST /identity/v3/projects => generated 302 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:36:59.243083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:59.411500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cfbd20-4fbe-4eed-829d-472210518771 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:59.441711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d453d360-8372-49ac-b738-5cb35bd2cf4a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:59.443233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:59.482694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:59.483485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:59.483867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:59.484268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/e0e17fe7e3984d7f92da9fa6d4676d15/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:59.486307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] RBAC: Authorizing `identity:create_grant(project_id=433dd2d3979a4228bf1eaa4d46e7a74a, user_id=e0e17fe7e3984d7f92da9fa6d4676d15, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:59.487979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:59.494703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:59.495679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:59.496125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:59.496561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:59.497765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:59.502783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:59.502783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 67/133] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:36:59 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:59.502783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:59.593788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 67/134] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:36:59 2022] PUT /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/e0e17fe7e3984d7f92da9fa6d4676d15/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:36:59.594988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:59.608583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd73e8d-d9e3-4b76-8ec3-8d65720b4a7c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:59.655756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:59.657136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:59.657574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:59.658015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:59.658951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] RBAC: Adding query filter params (role.id=52546a8fb3e040ebbb2ad35152d6f8a9, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=d75044eac6cd467ab9d7537817a5d5e2) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:36:59.659452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:59.661872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:59.674747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 68/135] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:36:59 2022] GET /identity/v3/role_assignments?user.id=d75044eac6cd467ab9d7537817a5d5e2&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=52546a8fb3e040ebbb2ad35152d6f8a9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:59.745156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:36:59.827015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373e524-d2ff-45cc-a208-22bde5f4fcdf None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:36:59.883654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0ee2d8-4d90-4ca1-8c2e-845aaa800f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:36:59.884485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ee2d8-4d90-4ca1-8c2e-845aaa800f74 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:36:59.884851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ee2d8-4d90-4ca1-8c2e-845aaa800f74 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:36:59.885209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0ee2d8-4d90-4ca1-8c2e-845aaa800f74 None admin] PATH_INFO: `/v3/projects/f75ee7c710fa475cbce6e47ee28d0279` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:36:59.886749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ee2d8-4d90-4ca1-8c2e-845aaa800f74 None admin] RBAC: Authorizing `identity:get_project(project_id=f75ee7c710fa475cbce6e47ee28d0279)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:36:59.888409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0ee2d8-4d90-4ca1-8c2e-845aaa800f74 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:36:59.890568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 68/136] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:36:59 2022] GET /identity/v3/projects/f75ee7c710fa475cbce6e47ee28d0279 => generated 312 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:36:59.897553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:36:59.949737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:00.034475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1365f-654d-483b-beba-1f7aa9dc0c62 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:00.076191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4d180-2f26-41b3-83fd-5878841f5869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:00.076868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d180-2f26-41b3-83fd-5878841f5869 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:00.077155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d180-2f26-41b3-83fd-5878841f5869 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:00.077495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4d180-2f26-41b3-83fd-5878841f5869 None admin] PATH_INFO: `/v3/projects/f75ee7c710fa475cbce6e47ee28d0279/users/e0e17fe7e3984d7f92da9fa6d4676d15/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:00.079865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4d180-2f26-41b3-83fd-5878841f5869 None admin] RBAC: Authorizing `identity:create_grant(project_id=f75ee7c710fa475cbce6e47ee28d0279, user_id=e0e17fe7e3984d7f92da9fa6d4676d15, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:00.081385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd4d180-2f26-41b3-83fd-5878841f5869 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:00.156881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 69/137] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:36:59 2022] PUT /identity/v3/projects/f75ee7c710fa475cbce6e47ee28d0279/users/e0e17fe7e3984d7f92da9fa6d4676d15/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:00.574369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf0a7-252a-4e2e-a616-f8197ede61dd None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:00.574933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf0a7-252a-4e2e-a616-f8197ede61dd None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:00.575251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804cf0a7-252a-4e2e-a616-f8197ede61dd None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:00.576869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 69/138] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:00.582496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad5cac-cb5b-4cf2-b5d0-89000a0c85c0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:00.582873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad5cac-cb5b-4cf2-b5d0-89000a0c85c0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:00.583169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ad5cac-cb5b-4cf2-b5d0-89000a0c85c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:00.611789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d0ad5cac-cb5b-4cf2-b5d0-89000a0c85c0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:00.613075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d0ad5cac-cb5b-4cf2-b5d0-89000a0c85c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:00.689924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 70/139] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:01.245619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cf0a7-252a-4e2e-a616-f8197ede61dd None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:01.365187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804cf0a7-252a-4e2e-a616-f8197ede61dd None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:01.406506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:01.406506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:01.406506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:01.406506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:01.406918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:01.422872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:01.428462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:01.429319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:01.430053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 70/140] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:01.439941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad5cac-cb5b-4cf2-b5d0-89000a0c85c0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:01.472842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:01.554476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ad5cac-cb5b-4cf2-b5d0-89000a0c85c0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:01.590100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:01.590726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:01.591870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:01.592150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:01.592884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:01.593196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:01.594569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:01.603016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 71/141] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:01.608900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:01.718785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97da97a1-3b24-4587-8089-1bef26071f4f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:01.751344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1207789-75a0-4150-a7b5-8d0f9e594509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:01.751986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1207789-75a0-4150-a7b5-8d0f9e594509 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:01.752273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1207789-75a0-4150-a7b5-8d0f9e594509 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:01.752565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1207789-75a0-4150-a7b5-8d0f9e594509 None admin] PATH_INFO: `/v3/users/6fcbd85e11364a39a93fb2a7be48da77` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:01.754410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1207789-75a0-4150-a7b5-8d0f9e594509 None admin] RBAC: Authorizing `identity:get_user(user_id=6fcbd85e11364a39a93fb2a7be48da77)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:01.755981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1207789-75a0-4150-a7b5-8d0f9e594509 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:01.757706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 71/142] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:01 2022] GET /identity/v3/users/6fcbd85e11364a39a93fb2a7be48da77 => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:01.763696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:01.827173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ad505-bbf3-4d53-8f40-e820416e80fa None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:01.827458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ad505-bbf3-4d53-8f40-e820416e80fa None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:01.827671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730ad505-bbf3-4d53-8f40-e820416e80fa None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:01.829596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 72/143] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:01.835860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0313-f80a-44b4-b45f-54317d473e9e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:01.836262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0313-f80a-44b4-b45f-54317d473e9e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:01.836640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a0313-f80a-44b4-b45f-54317d473e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:01.863477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-566a0313-f80a-44b4-b45f-54317d473e9e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:01.865215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-566a0313-f80a-44b4-b45f-54317d473e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:01.916158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:01.929255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:01.951228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 73/144] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 24 06:37:01.970393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efb91e1-7809-4a98-80a3-5a1c29b885b7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:02.028616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:02.029243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.029527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.029811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.116950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:02.118365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:02.154688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b50d15-3cd6-4748-aefe-c6526b05a385 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.155024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b50d15-3cd6-4748-aefe-c6526b05a385 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.155277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b50d15-3cd6-4748-aefe-c6526b05a385 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.160261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 74/145] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:02.168407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c3db-6c66-41a3-916b-83660d247032 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.168718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c3db-6c66-41a3-916b-83660d247032 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.169221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5250c3db-6c66-41a3-916b-83660d247032 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.200450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5250c3db-6c66-41a3-916b-83660d247032 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:02.201897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5250c3db-6c66-41a3-916b-83660d247032 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:02.238536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:02.262018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 72/146] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:02.283929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:02.319664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 75/147] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:02.399751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c3db-6c66-41a3-916b-83660d247032 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:02.444263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f59c486-1295-41f0-8fbe-bde57f7d08e2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:02.512037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:02.513144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.513646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.514139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.516237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:02.519659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:02.520854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5250c3db-6c66-41a3-916b-83660d247032 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:02.522411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 73/148] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:02 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:02.538639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:02.540356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:02.563641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:02.564297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.564584 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.569597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.581481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:02.586454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:02.587394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:02.588263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 76/149] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:02.595130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:02.633013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:02.723595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a86788-9902-47dd-945f-3dba80076602 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:02.760385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:02.761007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.761288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.761564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.762225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c94768-4b02-415d-888d-915f89e99b44 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:02.762347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:02.762596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:02.764176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:02.773642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 77/150] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:02.789101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:02.855163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:02.859514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0b405-e496-4aff-a744-6c30e297bd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:02.860447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0b405-e496-4aff-a744-6c30e297bd6c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.860733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0b405-e496-4aff-a744-6c30e297bd6c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.861010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0b405-e496-4aff-a744-6c30e297bd6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.862805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0b405-e496-4aff-a744-6c30e297bd6c None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=6fcbd85e11364a39a93fb2a7be48da77) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:02.862805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0b405-e496-4aff-a744-6c30e297bd6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:02.864126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0b405-e496-4aff-a744-6c30e297bd6c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:02.872029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 74/151] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:02 2022] GET /identity/v3/role_assignments?user.id=6fcbd85e11364a39a93fb2a7be48da77&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:02.873722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb420-6644-4b77-9935-6edbf5e6d625 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.874588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb420-6644-4b77-9935-6edbf5e6d625 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.875262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180eb420-6644-4b77-9935-6edbf5e6d625 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.877428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 75/152] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:02.885623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb85de-4d0d-492e-8e09-81cfec9bbf83 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:02.886225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb85de-4d0d-492e-8e09-81cfec9bbf83 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:02.886685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fb85de-4d0d-492e-8e09-81cfec9bbf83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:02.923320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-51fb85de-4d0d-492e-8e09-81cfec9bbf83 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:02.925182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-51fb85de-4d0d-492e-8e09-81cfec9bbf83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:02.998630 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d452-a807-4959-bc8d-554be61efd7c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.003132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 76/153] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:03.011022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7776a1f-28b0-4e4b-bea7-a735339932b4 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.011022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7776a1f-28b0-4e4b-bea7-a735339932b4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.011022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7776a1f-28b0-4e4b-bea7-a735339932b4 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.011022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 77/154] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:03.011022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7776a1f-28b0-4e4b-bea7-a735339932b4 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.052422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6b839-06a5-4d42-bfca-bb84572f2706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.053242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b839-06a5-4d42-bfca-bb84572f2706 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.053620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b839-06a5-4d42-bfca-bb84572f2706 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.053994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6b839-06a5-4d42-bfca-bb84572f2706 None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.055394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b839-06a5-4d42-bfca-bb84572f2706 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:03.058118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6b839-06a5-4d42-bfca-bb84572f2706 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:03.060325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 78/155] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:02 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:03.062855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13de68-4448-4c15-a583-8a2629ad5acf None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.062855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13de68-4448-4c15-a583-8a2629ad5acf None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.062855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13de68-4448-4c15-a583-8a2629ad5acf None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.063981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 79/156] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:03.066120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aecedc-9c78-4321-b344-47b8367f16c8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.066120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aecedc-9c78-4321-b344-47b8367f16c8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.066120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aecedc-9c78-4321-b344-47b8367f16c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.072123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.089716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-50aecedc-9c78-4321-b344-47b8367f16c8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:03.090961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-50aecedc-9c78-4321-b344-47b8367f16c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:03.138395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7776a1f-28b0-4e4b-bea7-a735339932b4 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.180517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e238eb-a58d-4aa6-a771-19b7fc600b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.181154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e238eb-a58d-4aa6-a771-19b7fc600b4f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.181437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e238eb-a58d-4aa6-a771-19b7fc600b4f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.181711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e238eb-a58d-4aa6-a771-19b7fc600b4f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.182811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 80/157] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:03.182988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e238eb-a58d-4aa6-a771-19b7fc600b4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:03.184441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e238eb-a58d-4aa6-a771-19b7fc600b4f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:03.186018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 78/158] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:03.190200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc2bc-72cb-448b-bf4f-9634810f1980 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.190200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc2bc-72cb-448b-bf4f-9634810f1980 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.190413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aecedc-9c78-4321-b344-47b8367f16c8 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.190505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6bc2bc-72cb-448b-bf4f-9634810f1980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.208887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ac6bc2bc-72cb-448b-bf4f-9634810f1980 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:03.210107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ac6bc2bc-72cb-448b-bf4f-9634810f1980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:03.234870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.293075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 79/159] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:03.294656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc2bc-72cb-448b-bf4f-9634810f1980 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.326321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aecedc-9c78-4321-b344-47b8367f16c8 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.348159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.365095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.369016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.369016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.369016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.420424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6bc2bc-72cb-448b-bf4f-9634810f1980 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.458954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.459597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.459838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.460121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.460792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:03.462239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:03.463922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:03.465616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:03.497803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.568764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 80/160] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:03 2022] POST /identity/v3/users => generated 283 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:03.578150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 81/161] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:03.580028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.583838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.724702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fe696-cf45-4f88-9433-7caa0bef82da None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.725321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdeba79-97f3-48f1-b2d6-18adedd233e7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.726374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.758267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:03.766542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.768791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.768791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.769012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.769115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.769197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.769197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.769397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.781415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:03.783830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:03.787400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:03.788319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:03.789089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 81/162] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:03.789825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:03.789931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:03.790701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 82/163] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:03.804775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.932808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9245feea-fb41-4291-ae27-32aa5833a3e5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.937126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552c697e-8352-4ddc-b8c5-05d3fae34745 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:03.972808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.973463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.973747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.974029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.983951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:03.984610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:03.985010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:03.985318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:03.986499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:03.988044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:03.988449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:03.989869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 82/164] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:03.990481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:03.998756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:03.999809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:04.000587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 83/165] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:04.001267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.031134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:04.058806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:04.124081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9942d66-f589-4335-b32f-43572b0d832c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.125701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccc911-bd0a-4734-8323-edd2fec4824e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.167787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.168853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.169552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.169665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.170081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.170478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.170902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.171278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.171385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] RBAC: Adding query filter params (name=member) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:04.171811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.172201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:04.172673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.173663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.174269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.184153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 84/167] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:04.184320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 83/167] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:04.185336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.185440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.281487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:04.292032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73e1e-8d19-4f10-a26e-7bed44601c5b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.292412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aef3d91-7c6b-4020-859e-7fe8e388a0ba None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.315917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:04.329445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.329865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.330811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.330908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.330993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.331203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.331542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.331918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] RBAC: Adding query filter params (role.id=91979b0781874aef81daab5791316f61, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=e0e17fe7e3984d7f92da9fa6d4676d15) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:04.332232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.332409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.333360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] RBAC: Adding query filter params (name=reader) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:04.333672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.334076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.335687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.344839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 84/169] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:04.345266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 85/169] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:04 2022] GET /identity/v3/role_assignments?user.id=e0e17fe7e3984d7f92da9fa6d4676d15&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=91979b0781874aef81daab5791316f61 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:04.346865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.346973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.468948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6a4a04-5215-4d0d-a3db-4d60f7f9d29b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.516579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.517663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.518685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.519206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.521685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.523756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.526007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 85/170] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:04 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:04.527454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.562553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:04.570628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985587d0-9b66-470b-9896-96bfb5ffb11c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.613942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.614685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.615031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.615354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] PATH_INFO: `/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.617697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] RBAC: Authorizing `identity:get_user(user_id=e0e17fe7e3984d7f92da9fa6d4676d15)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.619204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.621324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 86/171] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:04 2022] GET /identity/v3/users/e0e17fe7e3984d7f92da9fa6d4676d15 => generated 275 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:04.621838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.662620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd7aeb7-0bd8-442e-94e7-614864f5d7ff None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.682688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:04.727082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.727870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.728262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.728644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] PATH_INFO: `/v3/users/d75044eac6cd467ab9d7537817a5d5e2` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.731490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] RBAC: Authorizing `identity:get_user(user_id=d75044eac6cd467ab9d7537817a5d5e2)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.734213 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.738156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 86/172] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:04 2022] GET /identity/v3/users/d75044eac6cd467ab9d7537817a5d5e2 => generated 289 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:04.740318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:04.789700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5e057-caf3-4a4d-b1e6-81bc62b7cfe3 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.836363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.837846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.838498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.839029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.868883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:04.883548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580dfa1-2fd9-48e0-b0a9-92ceb43aec6d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:04.929698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:04.930103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:04.930962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:04.931232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:04.931635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:04.932117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:04.988671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:05.016930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:05.019245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:05.061472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 87/173] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:05.062135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:05.161970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:05.185283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 87/174] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:05.189092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:05.225061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e9714c-3846-44a9-a22f-c17a682c985b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:05.266983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:05.268097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:05.268812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:05.269291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:05.270636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:05.272940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:05.275114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 88/175] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:05 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:05.276169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:05.289862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:05.379252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3fb0e4-a6f4-464e-b22b-4c7ac5eea2f5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:05.384627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8106a032-0eef-4105-aa17-5d5a45ea9666 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:05.429864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:05.432026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:05.432731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:05.433657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:05.435699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:05.438219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:05.442392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 89/176] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:05 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:05.444837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:05.449526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:05.450429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:05.450968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:05.451433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] PATH_INFO: `/v3/projects/f75ee7c710fa475cbce6e47ee28d0279` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:05.459579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] RBAC: Authorizing `identity:get_project(project_id=f75ee7c710fa475cbce6e47ee28d0279)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:05.461344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:05.463363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 88/177] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:05 2022] GET /identity/v3/projects/f75ee7c710fa475cbce6e47ee28d0279 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:05.464400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:05.567166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:05.576807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:05.592353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51179c06-dc02-4861-88d7-976d3f36e25a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:05.632148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c86d3-3d21-4150-8f3f-0c196330f191 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:05.636714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4e1de-0dfa-4d49-b770-70661e52beef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:05.637402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e1de-0dfa-4d49-b770-70661e52beef None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:05.637683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e1de-0dfa-4d49-b770-70661e52beef None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:05.637960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4e1de-0dfa-4d49-b770-70661e52beef None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/d75044eac6cd467ab9d7537817a5d5e2/roles/52546a8fb3e040ebbb2ad35152d6f8a9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:05.640988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4e1de-0dfa-4d49-b770-70661e52beef None admin] RBAC: Authorizing `identity:create_grant(project_id=433dd2d3979a4228bf1eaa4d46e7a74a, user_id=d75044eac6cd467ab9d7537817a5d5e2, role_id=52546a8fb3e040ebbb2ad35152d6f8a9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:05.642454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee4e1de-0dfa-4d49-b770-70661e52beef None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:05.690194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:05.691127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:05.691547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:05.691955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:05.693345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=e0e17fe7e3984d7f92da9fa6d4676d15) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:05.693808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:05.695738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:05.703069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 89/178] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:05 2022] GET /identity/v3/role_assignments?user.id=e0e17fe7e3984d7f92da9fa6d4676d15&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 608 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:05.703922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:05.728658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 90/179] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:37:05 2022] PUT /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/users/d75044eac6cd467ab9d7537817a5d5e2/roles/52546a8fb3e040ebbb2ad35152d6f8a9 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:05.859862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9429029-90e8-4de3-b263-b78a2e2c504f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:05.888532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:05.903198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1f4098-73e0-49a5-8f58-a1a8064a58ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:05.903833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f4098-73e0-49a5-8f58-a1a8064a58ca None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:05.904116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f4098-73e0-49a5-8f58-a1a8064a58ca None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:05.904397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1f4098-73e0-49a5-8f58-a1a8064a58ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:05.905263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f4098-73e0-49a5-8f58-a1a8064a58ca None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=f75ee7c710fa475cbce6e47ee28d0279, user.id=e0e17fe7e3984d7f92da9fa6d4676d15) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:05.905577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f4098-73e0-49a5-8f58-a1a8064a58ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:05.907449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1f4098-73e0-49a5-8f58-a1a8064a58ca None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:05.916920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 90/180] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:05 2022] GET /identity/v3/role_assignments?user.id=e0e17fe7e3984d7f92da9fa6d4676d15&scope.project.id=f75ee7c710fa475cbce6e47ee28d0279&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:06.009513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40974-aafa-4a9d-ac44-195d16a710f2 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.010176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40974-aafa-4a9d-ac44-195d16a710f2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.010176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a40974-aafa-4a9d-ac44-195d16a710f2 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.011548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 91/181] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:06.017985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55873f2-9ff8-443c-b276-4b400f4b1d36 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.018349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55873f2-9ff8-443c-b276-4b400f4b1d36 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.018577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55873f2-9ff8-443c-b276-4b400f4b1d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.044284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b55873f2-9ff8-443c-b276-4b400f4b1d36 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:06.045542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b55873f2-9ff8-443c-b276-4b400f4b1d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:06.128124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 91/182] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:06.414850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40974-aafa-4a9d-ac44-195d16a710f2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:06.526364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a40974-aafa-4a9d-ac44-195d16a710f2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:06.565176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63be8dfb-8096-4583-8632-df823c47844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:06.565836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8dfb-8096-4583-8632-df823c47844e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.566123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8dfb-8096-4583-8632-df823c47844e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.566402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63be8dfb-8096-4583-8632-df823c47844e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.573944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:06.579490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63be8dfb-8096-4583-8632-df823c47844e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-63be8dfb-8096-4583-8632-df823c47844e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:06.586746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:06.597647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:06.598447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 92/183] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:06.599147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55873f2-9ff8-443c-b276-4b400f4b1d36 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:06.643376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fd7ad-e746-4098-b172-2b0431ecb093 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.648797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fd7ad-e746-4098-b172-2b0431ecb093 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.648797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9fd7ad-e746-4098-b172-2b0431ecb093 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.648797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 93/184] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:37:06.650459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6478a2-8727-44c8-ae85-9c20aa45c229 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.650746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6478a2-8727-44c8-ae85-9c20aa45c229 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.651062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6478a2-8727-44c8-ae85-9c20aa45c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.671118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ed6478a2-8727-44c8-ae85-9c20aa45c229 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:06.673188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ed6478a2-8727-44c8-ae85-9c20aa45c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:06.722714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55873f2-9ff8-443c-b276-4b400f4b1d36 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:06.744446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:06.764119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ff3d44-d13d-4417-9a45-7ad49adad9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:06.764856 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3d44-d13d-4417-9a45-7ad49adad9b3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.765122 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3d44-d13d-4417-9a45-7ad49adad9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.765406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff3d44-d13d-4417-9a45-7ad49adad9b3 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.766088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff3d44-d13d-4417-9a45-7ad49adad9b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:06.766420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff3d44-d13d-4417-9a45-7ad49adad9b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:06.767823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ff3d44-d13d-4417-9a45-7ad49adad9b3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:06.773764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 94/185] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:06.789757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 92/186] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:06.797022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6478a2-8727-44c8-ae85-9c20aa45c229 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:06.844353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b878d-ad5a-4699-803b-4c45a3451be1 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.844703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b878d-ad5a-4699-803b-4c45a3451be1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.844916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b878d-ad5a-4699-803b-4c45a3451be1 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.846404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 93/187] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:37:06.852179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ebd92-65ae-4fe0-89ad-1c3ef76c1fbf None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.852629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ebd92-65ae-4fe0-89ad-1c3ef76c1fbf None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.853034 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ebd92-65ae-4fe0-89ad-1c3ef76c1fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.880504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-585ebd92-65ae-4fe0-89ad-1c3ef76c1fbf None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:06.882175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-585ebd92-65ae-4fe0-89ad-1c3ef76c1fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:06.922547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6478a2-8727-44c8-ae85-9c20aa45c229 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:06.956959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:06.966220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:06.967449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:06.968135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:06.969337 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] PATH_INFO: `/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:06.987141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 94/188] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:06.988820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] RBAC: Authorizing `identity:get_user(user_id=82d4ccaa2efa48fea7d6408ebed2e1e9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:06.990406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:06.992210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 95/189] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:06 2022] GET /identity/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9 => generated 283 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:06.998058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ebd92-65ae-4fe0-89ad-1c3ef76c1fbf None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.052765 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.136187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ebd92-65ae-4fe0-89ad-1c3ef76c1fbf None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.146443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:07.176753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.178901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.179563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.180068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.182014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0f401-7593-45b6-b3d8-aaa2392235ce None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.228437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.229091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.229374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.229650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.244874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:07.251309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:07.252291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:07.253075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 96/190] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:07.258338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.262822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:07.264765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:07.316732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:07.374705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 95/191] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:07.374961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8009b-0146-40ef-9cfd-ba4197f81106 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.375399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.389318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:07.412428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.413043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.413327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.413603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.414349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:07.414657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:07.416243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:07.425837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 97/192] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:07.426550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.490181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b6cb55-cf0d-4d30-9258-be4d339f8eaa None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.527544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.528184 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.528461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.528740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.529875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:07.531451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:07.534886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 96/193] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:07.534886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.535098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ee797-2c68-4e47-8fbc-837a48364440 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.546951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:07.572610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.573249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.573534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.573823 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.575017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:07.576499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:07.578811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 98/194] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:07 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:07.579933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.629308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:07.652936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089cb03-14a0-4e83-bf5f-ac0cc86e0676 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.690099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5500b-db34-44ce-ba39-d7748a9399db None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.691209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.691863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.692150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.692428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] PATH_INFO: `/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.693620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] RBAC: Authorizing `identity:get_user(user_id=82d4ccaa2efa48fea7d6408ebed2e1e9)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:07.696803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:07.696803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 97/195] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:07 2022] GET /identity/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:07.702129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.733232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.733851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.734136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.734417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.735124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:07.736609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:07.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0db9d-a600-46ea-8301-abf8e875a31c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:07.838956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 99/196] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:07 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:07.838956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:07.868751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01320853-5bf2-42b6-a92d-d5c36489e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:07.869837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01320853-5bf2-42b6-a92d-d5c36489e963 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:07.870271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01320853-5bf2-42b6-a92d-d5c36489e963 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:07.870699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01320853-5bf2-42b6-a92d-d5c36489e963 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:07.871650 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01320853-5bf2-42b6-a92d-d5c36489e963 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=82d4ccaa2efa48fea7d6408ebed2e1e9) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:07.872245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01320853-5bf2-42b6-a92d-d5c36489e963 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:07.873896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01320853-5bf2-42b6-a92d-d5c36489e963 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:07.882799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 98/197] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:07 2022] GET /identity/v3/role_assignments?user.id=82d4ccaa2efa48fea7d6408ebed2e1e9&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:07.888378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:07.993642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dcbed3-33ff-40b1-b6dc-4a1b263f3159 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:08.039894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:08.040851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:08.041280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:08.041722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:08.045638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716c7d0-aa2d-4a15-9a91-6558450ce236 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:08.045925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716c7d0-aa2d-4a15-9a91-6558450ce236 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:08.046206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716c7d0-aa2d-4a15-9a91-6558450ce236 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:08.047846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 99/198] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:37:08.053900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895b070-f2e4-4ab1-90ad-c8fa00bf5636 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:08.054251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895b070-f2e4-4ab1-90ad-c8fa00bf5636 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:08.054537 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3895b070-f2e4-4ab1-90ad-c8fa00bf5636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:08.079239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3895b070-f2e4-4ab1-90ad-c8fa00bf5636 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:08.080414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3895b070-f2e4-4ab1-90ad-c8fa00bf5636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:08.082677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:08.139037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:08.140548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:08.180446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:08.196466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 100/199] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:08.261317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 100/200] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:08.267022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895b070-f2e4-4ab1-90ad-c8fa00bf5636 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:08.386596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3895b070-f2e4-4ab1-90ad-c8fa00bf5636 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:08.429382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:08.430036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:08.430319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:08.430595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:08.431799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:08.433252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:08.435269 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 101/201] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:08 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:08.441371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:08.500284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:08.514300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:08.624567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa85610-9ec5-4fa6-bdf1-38fd79ab5b9c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:08.656916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:08.663019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:08.663748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:08.664076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:08.664313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:08.666431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] RBAC: Adding query filter params (role.id=91979b0781874aef81daab5791316f61, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=82d4ccaa2efa48fea7d6408ebed2e1e9) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:08.666431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:08.667039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:08.673857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 101/202] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:08 2022] GET /identity/v3/role_assignments?user.id=82d4ccaa2efa48fea7d6408ebed2e1e9&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=91979b0781874aef81daab5791316f61 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:08.697065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02157d8-6e70-42dd-a629-d26c59467854 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:08.750833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:08.751529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:08.751817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:08.752131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:08.771850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:08.777431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:08.778299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:08.779189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 102/203] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:08.786866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:08.920967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47aefc84-1e77-4e67-ad64-382241fcf059 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:08.957794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:08.958412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:08.958744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:08.959056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:08.959734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:08.960042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:08.961430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:08.971684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 102/204] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:08.979332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:09.069737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:09.112473 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96321f71-4048-4aa2-9afd-d6a7d670b99d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:09.157763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:09.158824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:09.159304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:09.159816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] PATH_INFO: `/v3/users/d75044eac6cd467ab9d7537817a5d5e2` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:09.163428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] RBAC: Authorizing `identity:get_user(user_id=d75044eac6cd467ab9d7537817a5d5e2)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:09.165075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:09.167161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 103/205] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:08 2022] GET /identity/v3/users/d75044eac6cd467ab9d7537817a5d5e2 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:09.173291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:09.277692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:09.344229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7366c-de01-4f74-a7de-085b2bccfc09 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:09.391978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:09.392600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:09.392944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:09.393224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:09.472701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:09.474247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:09.544060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:09.599861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 103/206] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:09.605613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:09.766696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc084ae0-9bbf-4230-b9b0-c7a20302733d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:09.819500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdace221-bf94-43d4-8481-8ff1c514f991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:09.820155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdace221-bf94-43d4-8481-8ff1c514f991 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:09.820548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdace221-bf94-43d4-8481-8ff1c514f991 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:09.820830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdace221-bf94-43d4-8481-8ff1c514f991 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:09.822030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdace221-bf94-43d4-8481-8ff1c514f991 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:09.823498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdace221-bf94-43d4-8481-8ff1c514f991 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:09.825292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 104/207] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:09 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:09.832219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:10.011900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e35829-675f-4b46-8931-37ef38bdc946 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:10.060302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a282b-a957-4f6f-8b11-5260a5b08c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:10.061304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a282b-a957-4f6f-8b11-5260a5b08c50 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.061792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a282b-a957-4f6f-8b11-5260a5b08c50 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.062287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a282b-a957-4f6f-8b11-5260a5b08c50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.063267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a282b-a957-4f6f-8b11-5260a5b08c50 None admin] RBAC: Adding query filter params (role.id=52546a8fb3e040ebbb2ad35152d6f8a9, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a, user.id=d75044eac6cd467ab9d7537817a5d5e2) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:10.063781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a282b-a957-4f6f-8b11-5260a5b08c50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:10.065965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a282b-a957-4f6f-8b11-5260a5b08c50 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:10.075561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 104/208] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:09 2022] GET /identity/v3/role_assignments?user.id=d75044eac6cd467ab9d7537817a5d5e2&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=52546a8fb3e040ebbb2ad35152d6f8a9 => generated 608 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:10.237277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9c8e-648c-4b6f-88af-907e725232e2 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.237623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9c8e-648c-4b6f-88af-907e725232e2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.237834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9c8e-648c-4b6f-88af-907e725232e2 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.239270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 105/209] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:10.245180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c8ba-b6ef-44a4-a9dc-e849f79e3c07 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.246159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c8ba-b6ef-44a4-a9dc-e849f79e3c07 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.246676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4890c8ba-b6ef-44a4-a9dc-e849f79e3c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.270179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4890c8ba-b6ef-44a4-a9dc-e849f79e3c07 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:10.272012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4890c8ba-b6ef-44a4-a9dc-e849f79e3c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:10.291708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:10.350702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 105/210] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:10.462172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e1a9e-651c-4aaa-973c-8c47d3c4c41f None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.463006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e1a9e-651c-4aaa-973c-8c47d3c4c41f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.463700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9e1a9e-651c-4aaa-973c-8c47d3c4c41f None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.466966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 106/211] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:10.472348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64558a6c-fe59-4a0f-840c-bd61c8245fa3 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.472708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64558a6c-fe59-4a0f-840c-bd61c8245fa3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.472885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64558a6c-fe59-4a0f-840c-bd61c8245fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.492340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-64558a6c-fe59-4a0f-840c-bd61c8245fa3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:10.493616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-64558a6c-fe59-4a0f-840c-bd61c8245fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:10.567432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 106/212] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:10.631190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e1a9e-651c-4aaa-973c-8c47d3c4c41f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:10.634366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:10.719809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b7643-406c-47de-a3b5-5de06fdda98b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.720099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b7643-406c-47de-a3b5-5de06fdda98b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.720380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b7643-406c-47de-a3b5-5de06fdda98b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.722344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 107/213] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:10.728053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1103a-7905-4328-a323-d551008779ed None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.728642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1103a-7905-4328-a323-d551008779ed None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.729157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead1103a-7905-4328-a323-d551008779ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.755029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ead1103a-7905-4328-a323-d551008779ed None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:10.756606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ead1103a-7905-4328-a323-d551008779ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:10.762634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9e1a9e-651c-4aaa-973c-8c47d3c4c41f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:10.826608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:10.827271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:10.828103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:10.828396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:10.841282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 108/214] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:10.847887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:10.853355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:10.854293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:10.855114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 107/215] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:10.855798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1103a-7905-4328-a323-d551008779ed None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:10.862848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:10.874825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:10.950053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:10.988805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead1103a-7905-4328-a323-d551008779ed None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:10.999937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb7d28-2e9b-4002-a4cd-55c6aaf65af1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.027188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.028063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.028499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.028952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.030377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.032015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 109/216] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:11.035770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.036459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.036813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.037160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.037918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:11.038296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.039602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.039955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.054408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 108/217] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:11.055424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.131311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:11.151385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1587e9cc-a966-4d02-8c10-7bda1545306a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.160387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e864ad-d7e1-4f97-b457-24a135375050 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.186067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:11.188411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.189037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.189319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.189628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.190287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.191804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.197158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.197793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.198076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.198354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] PATH_INFO: `/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.199677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=82d4ccaa2efa48fea7d6408ebed2e1e9)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.201191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.202913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 109/218] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:11 2022] GET /identity/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9 => generated 283 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:11.207792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.299136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 110/219] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:11 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:11.299972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.315973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77dcb1-31ac-446e-baa0-92c71092c3a3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.360298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b8b6ad-0c56-4430-82ea-bb27b89e4981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.360976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b6ad-0c56-4430-82ea-bb27b89e4981 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.361298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b6ad-0c56-4430-82ea-bb27b89e4981 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.361579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b8b6ad-0c56-4430-82ea-bb27b89e4981 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.373329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b8b6ad-0c56-4430-82ea-bb27b89e4981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-50b8b6ad-0c56-4430-82ea-bb27b89e4981 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:11.378983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:11.379962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:11.380951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 110/220] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:11.382215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370930c-1053-4796-aa7f-97949ab89a96 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.382215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370930c-1053-4796-aa7f-97949ab89a96 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.382215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370930c-1053-4796-aa7f-97949ab89a96 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.383296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 111/221] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:11.386229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370930c-1053-4796-aa7f-97949ab89a96 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.427368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d9056-b0a5-4d8a-a5aa-6fc52ee32045 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.448725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:11.469540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808009-37d5-4f1e-a4f4-02d5ebaacdb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.470110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808009-37d5-4f1e-a4f4-02d5ebaacdb3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.470391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808009-37d5-4f1e-a4f4-02d5ebaacdb3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.470716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808009-37d5-4f1e-a4f4-02d5ebaacdb3 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.471895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3808009-37d5-4f1e-a4f4-02d5ebaacdb3 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.473356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3808009-37d5-4f1e-a4f4-02d5ebaacdb3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.475115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 111/222] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:11 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:11.476394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489092-7ee0-4435-ad53-b484433ef6e6 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.476680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489092-7ee0-4435-ad53-b484433ef6e6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.476950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a489092-7ee0-4435-ad53-b484433ef6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.485203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:11.496889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2a489092-7ee0-4435-ad53-b484433ef6e6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:11.498107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2a489092-7ee0-4435-ad53-b484433ef6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:11.509921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370930c-1053-4796-aa7f-97949ab89a96 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.557253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.557890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.558171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.558453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.559190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] RBAC: Adding query filter params (name=member) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:11.559500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.560925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.579747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 112/223] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:11.581003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.596901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 112/224] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:11.597934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489092-7ee0-4435-ad53-b484433ef6e6 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.726708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4acac5-1ef9-42a7-a1ea-7b67336223e1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.744532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a489092-7ee0-4435-ad53-b484433ef6e6 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:11.746501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:11.776924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.778997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.779232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.779831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/82d4ccaa2efa48fea7d6408ebed2e1e9/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.782439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede9eab9f294a77abf9b1ae62ce83cb, user_id=82d4ccaa2efa48fea7d6408ebed2e1e9, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.784810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.794850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:11.795581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:11.795869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:11.796146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] PATH_INFO: `/v3/users/411047b615a4444eb365e00a097c521c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:11.798494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:11.812842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] RBAC: Authorizing `identity:get_user(user_id=411047b615a4444eb365e00a097c521c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:11.814469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:11.816305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 113/225] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:11 2022] GET /identity/v3/users/411047b615a4444eb365e00a097c521c => generated 297 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:11.822241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.870708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 113/226] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:37:11 2022] PUT /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/82d4ccaa2efa48fea7d6408ebed2e1e9/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:11.937018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:11.963102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c59a254-d1ca-4e1d-91ca-2d853bf667d0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:12.039963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:12.041563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:12.042384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:12.043186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:12.078174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b39cd50-4c1f-4a86-9a55-c39386ad53c7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:12.118296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:12.119030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:12.119329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:12.119607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:12.125041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:12.132722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:12.135972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:12.138354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:12.143351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:12.144373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:12.145123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:12.145205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 114/227] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:12.153550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:12.201932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:12.262131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 114/228] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:12.268256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:12.271009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d1fb1-4934-4102-b5fe-6ded69c0737a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:12.335612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:12.336550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:12.337057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:12.337520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:12.338396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:12.338917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:12.340506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:12.358844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 115/229] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:12.377390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:12.431773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:12.450526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ef70b-b772-4704-b6e6-a1f2079cc5b7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:12.524195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:12.524846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:12.525131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:12.525407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:12.527232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:12.528705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:12.531074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 115/230] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:12 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:12.531322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:12.540074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cdf519-9119-4037-8f6e-e183a9642522 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:12.544800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:12.601905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:12.602467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:12.602754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:12.603056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] PATH_INFO: `/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:12.606474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] RBAC: Authorizing `identity:get_user(user_id=82d4ccaa2efa48fea7d6408ebed2e1e9)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:12.608089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:12.610235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 116/231] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:12 2022] GET /identity/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:12.615724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:12.663175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591ca53-9582-496d-9ebc-9274fd0180ad None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:12.715533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:12.716220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:12.716507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:12.716778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:12.717528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=411047b615a4444eb365e00a097c521c) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:12.717841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:12.719357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:12.732964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 116/232] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:12 2022] GET /identity/v3/role_assignments?user.id=411047b615a4444eb365e00a097c521c&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:12.800177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4faa131-acc6-429f-b4a5-72e2ecf56202 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:12.847951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd251a3-4785-4804-901a-f91382bfa3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:12.848622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd251a3-4785-4804-901a-f91382bfa3f0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:12.848902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd251a3-4785-4804-901a-f91382bfa3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:12.849179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd251a3-4785-4804-901a-f91382bfa3f0 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:12.850411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd251a3-4785-4804-901a-f91382bfa3f0 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:12.852083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd251a3-4785-4804-901a-f91382bfa3f0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:12.853659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 117/233] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:12 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:12.859629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:12.893150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:12.980881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335443-9a8d-4fae-8120-76b32c33cf98 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:13.018885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b58ea-c3b3-43d8-8649-93ef9c27fbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:13.019576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b58ea-c3b3-43d8-8649-93ef9c27fbb1 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:13.020027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b58ea-c3b3-43d8-8649-93ef9c27fbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:13.020311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b58ea-c3b3-43d8-8649-93ef9c27fbb1 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/82d4ccaa2efa48fea7d6408ebed2e1e9/roles/91979b0781874aef81daab5791316f61` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:13.022518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b58ea-c3b3-43d8-8649-93ef9c27fbb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede9eab9f294a77abf9b1ae62ce83cb, user_id=82d4ccaa2efa48fea7d6408ebed2e1e9, role_id=91979b0781874aef81daab5791316f61)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:13.024005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369b58ea-c3b3-43d8-8649-93ef9c27fbb1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:13.135067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 117/234] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:37:12 2022] PUT /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/82d4ccaa2efa48fea7d6408ebed2e1e9/roles/91979b0781874aef81daab5791316f61 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:13.776066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798a65-95e7-4a40-ad9e-064a47561c6c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:13.777078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798a65-95e7-4a40-ad9e-064a47561c6c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:13.777559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42798a65-95e7-4a40-ad9e-064a47561c6c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:13.779431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 118/235] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:13.790530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5deb-02e1-4fd8-bfb0-ae8ac60fada8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:13.791530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5deb-02e1-4fd8-bfb0-ae8ac60fada8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:13.792017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f5deb-02e1-4fd8-bfb0-ae8ac60fada8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:13.816094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ac2f5deb-02e1-4fd8-bfb0-ae8ac60fada8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:13.817661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ac2f5deb-02e1-4fd8-bfb0-ae8ac60fada8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:13.892264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402dd8a-05ac-4a7a-9ee6-1b733a042f29 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:13.893565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402dd8a-05ac-4a7a-9ee6-1b733a042f29 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:13.894041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402dd8a-05ac-4a7a-9ee6-1b733a042f29 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:13.895650 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 119/236] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:13.908695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa278d-4d57-4283-87bd-f6e339634189 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:13.909314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa278d-4d57-4283-87bd-f6e339634189 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:13.909819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa278d-4d57-4283-87bd-f6e339634189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:13.928712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-befa278d-4d57-4283-87bd-f6e339634189 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:13.930283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-befa278d-4d57-4283-87bd-f6e339634189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:13.945785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 118/237] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:13.972132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:14.027255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 120/238] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:14.293145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f5deb-02e1-4fd8-bfb0-ae8ac60fada8 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:14.315614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:14.346901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa278d-4d57-4283-87bd-f6e339634189 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:14.474265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f5deb-02e1-4fd8-bfb0-ae8ac60fada8 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:14.519418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550dff18-46c8-4156-a6c7-99b9d0f2ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:14.521742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dff18-46c8-4156-a6c7-99b9d0f2ea00 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:14.522033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dff18-46c8-4156-a6c7-99b9d0f2ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:14.522318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550dff18-46c8-4156-a6c7-99b9d0f2ea00 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:14.534484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550dff18-46c8-4156-a6c7-99b9d0f2ea00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:14.535192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa278d-4d57-4283-87bd-f6e339634189 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-550dff18-46c8-4156-a6c7-99b9d0f2ea00 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:14.539641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:14.540504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:14.541327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 119/239] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:14.543458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dada7e-7b7e-45cd-8285-ea23210019a2 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:14.543940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dada7e-7b7e-45cd-8285-ea23210019a2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:14.544231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dada7e-7b7e-45cd-8285-ea23210019a2 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:14.550068 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 120/240] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:14.550068 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dada7e-7b7e-45cd-8285-ea23210019a2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:14.588855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b314201-c5a5-4e26-83ba-9b2312bf611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:14.591043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314201-c5a5-4e26-83ba-9b2312bf611c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:14.591614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314201-c5a5-4e26-83ba-9b2312bf611c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:14.592098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b314201-c5a5-4e26-83ba-9b2312bf611c None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:14.593638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314201-c5a5-4e26-83ba-9b2312bf611c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:14.596945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b314201-c5a5-4e26-83ba-9b2312bf611c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:14.600174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 121/241] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:14.601663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96389-eea7-4cf3-84e9-40a5e80332bd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:14.602185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96389-eea7-4cf3-84e9-40a5e80332bd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:14.602663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f96389-eea7-4cf3-84e9-40a5e80332bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:14.627242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d7f96389-eea7-4cf3-84e9-40a5e80332bd None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:14.629036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d7f96389-eea7-4cf3-84e9-40a5e80332bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:14.639419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:14.663008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:14.675807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dada7e-7b7e-45cd-8285-ea23210019a2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:14.721320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 122/242] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:14.723620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96389-eea7-4cf3-84e9-40a5e80332bd None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:14.736797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:14.737652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:14.738079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:14.738497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:14.739338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] RBAC: Adding query filter params (name=reader) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:14.739805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:14.741347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:14.757693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 121/243] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:14.766799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:14.885310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f96389-eea7-4cf3-84e9-40a5e80332bd None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:14.921458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8706df36-59d0-4bf8-b88b-f174b44e793f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:14.932976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:14.933772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:14.934156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:14.934605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:14.935405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:14.937004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:14.981801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:14.982574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:14.982886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:14.983443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] PATH_INFO: `/v3/users/4164e05f7a5c40bf87e2dafe140227c8` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:14.986611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:14.999052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] RBAC: Authorizing `identity:get_user(user_id=4164e05f7a5c40bf87e2dafe140227c8)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:15.000604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:15.002493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 122/244] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:14 2022] GET /identity/v3/users/4164e05f7a5c40bf87e2dafe140227c8 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:15.007756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:15.019831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 123/245] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:14 2022] POST /identity/v3/users => generated 293 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:15.089168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:15.127157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:15.184864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9959ef14-49c6-49f1-8d44-883b7ca59f52 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:15.250734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3c938-9bfe-4c5d-a260-51a080b3a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:15.251343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3c938-9bfe-4c5d-a260-51a080b3a678 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.251665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3c938-9bfe-4c5d-a260-51a080b3a678 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.251943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3c938-9bfe-4c5d-a260-51a080b3a678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.273529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2dfe3-e26d-44f8-8911-2dea3a8be137 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:15.327664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f69229-be7c-4168-97c3-d8f07ca975f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:15.328723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69229-be7c-4168-97c3-d8f07ca975f7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.329235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69229-be7c-4168-97c3-d8f07ca975f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.329751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f69229-be7c-4168-97c3-d8f07ca975f7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.350828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f69229-be7c-4168-97c3-d8f07ca975f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-46f69229-be7c-4168-97c3-d8f07ca975f7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:15.357023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:15.357918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:15.358701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:15.362622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:15.362696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 124/246] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:15.362696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07ad1-853d-4b89-9817-13f7e787bd1c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.362696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07ad1-853d-4b89-9817-13f7e787bd1c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.362696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d07ad1-853d-4b89-9817-13f7e787bd1c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.362696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 125/247] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:15.370471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d07ad1-853d-4b89-9817-13f7e787bd1c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:15.370548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3c938-9bfe-4c5d-a260-51a080b3a678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:15.370548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3c938-9bfe-4c5d-a260-51a080b3a678 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:15.487009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:15.516781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 123/248] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:15.519479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861965-724c-4e4b-aab0-ec786aed3e8c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.519479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861965-724c-4e4b-aab0-ec786aed3e8c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.519864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56861965-724c-4e4b-aab0-ec786aed3e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.523362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d07ad1-853d-4b89-9817-13f7e787bd1c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:15.541884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-56861965-724c-4e4b-aab0-ec786aed3e8c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:15.543423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-56861965-724c-4e4b-aab0-ec786aed3e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:15.569149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:15.570140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.570435 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.570792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.571517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:15.572143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:15.574446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:15.587748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 126/249] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:15.591761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:15.634843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 124/250] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:15.636048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ed05-be55-4cd0-84eb-3d9c6f45af62 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.636339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ed05-be55-4cd0-84eb-3d9c6f45af62 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.636612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899ed05-be55-4cd0-84eb-3d9c6f45af62 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.638836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 125/251] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:15.640229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ed05-be55-4cd0-84eb-3d9c6f45af62 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:15.677568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:15.738259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55dc8a-9911-44cc-bd05-ca12496030e4 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:15.769839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b899ed05-be55-4cd0-84eb-3d9c6f45af62 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:15.776985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989a25f-e008-4400-9448-b4352e10a187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:15.778051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a25f-e008-4400-9448-b4352e10a187 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.778556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a25f-e008-4400-9448-b4352e10a187 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.779061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989a25f-e008-4400-9448-b4352e10a187 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.780524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989a25f-e008-4400-9448-b4352e10a187 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:15.782308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989a25f-e008-4400-9448-b4352e10a187 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:15.784414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 127/252] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:15 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:15.785867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd476b3c-50fe-421d-a0f3-139949dd1f50 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.786399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd476b3c-50fe-421d-a0f3-139949dd1f50 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.786899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd476b3c-50fe-421d-a0f3-139949dd1f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.801667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:15.808522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-cd476b3c-50fe-421d-a0f3-139949dd1f50 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:15.810496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cd476b3c-50fe-421d-a0f3-139949dd1f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:15.812386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:15.813110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.813493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.813817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] PATH_INFO: `/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.816097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] RBAC: Authorizing `identity:get_user(user_id=82d4ccaa2efa48fea7d6408ebed2e1e9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:15.817272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:15.819022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 126/253] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:15 2022] GET /identity/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:15.819874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:15.889685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 128/254] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:15.891353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd476b3c-50fe-421d-a0f3-139949dd1f50 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:15.916362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:15.925925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c176483-be44-4d49-ae61-e51f4efeb562 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:15.968750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:15.969366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:15.969648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:15.969921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:15.970799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] RBAC: Adding query filter params (role.id=52546a8fb3e040ebbb2ad35152d6f8a9, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=4164e05f7a5c40bf87e2dafe140227c8) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:15.971113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:15.973427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:15.992375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 127/255] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:15 2022] GET /identity/v3/role_assignments?user.id=4164e05f7a5c40bf87e2dafe140227c8&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=52546a8fb3e040ebbb2ad35152d6f8a9 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:16.032153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd476b3c-50fe-421d-a0f3-139949dd1f50 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:16.048342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:16.107743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:16.108790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:16.109369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:16.109860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:16.117141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:16.195954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d4353-d18b-4c82-919e-8ad2a97e0255 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:16.223199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:16.225053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:16.238137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:16.239147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:16.239607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:16.240040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:16.260810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:16.270650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:16.271758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:16.272736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:16.275551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 128/256] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:16.281341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:16.320970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:16.417453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 129/257] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:16.418908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:16.488874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e86ce7a-1a99-4865-a0af-7aee09a3ad58 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:16.490355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:16.527506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:16.528519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:16.528999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:16.529467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:16.530427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:16.530987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:16.532606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:16.543010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 129/258] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:16.544514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:16.627137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:16.649203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1ad24c-44e3-417f-83e5-ee06df753c8a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:16.685641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ee23ab-686d-4401-a3ac-7e02e97e2b66 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:16.708668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:16.709680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:16.710304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:16.710934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:16.712398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:16.714294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:16.722713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 130/259] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:16 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:16.722713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:16.729736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:16.730174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:16.730451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:16.730719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:16.752850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:16.757725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:16.758649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:16.759502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 130/260] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:16.760216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:16.912812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9f4aa-0711-4d8a-897e-4450677d37ac None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:16.943852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:16.952738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53366d46-599a-491c-b2ae-e794a3fbc97c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:16.958233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:16.959486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:16.960007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:16.960510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] PATH_INFO: `/v3/users/411047b615a4444eb365e00a097c521c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:16.963868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] RBAC: Authorizing `identity:get_user(user_id=411047b615a4444eb365e00a097c521c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:16.965664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:16.970869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 131/261] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:16 2022] GET /identity/v3/users/411047b615a4444eb365e00a097c521c => generated 297 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:16.972002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:16.992954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:17.055477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:17.056108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.056397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.056688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.057708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=82d4ccaa2efa48fea7d6408ebed2e1e9) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:17.057708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:17.059366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:17.076899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 131/262] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:16 2022] GET /identity/v3/role_assignments?user.id=82d4ccaa2efa48fea7d6408ebed2e1e9&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:17.077736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:17.082798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb21af1-b93b-4de1-b42f-91d5f44a02fd None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:17.122973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:17.123983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.124467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.124961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.125864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:17.126366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:17.129358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:17.140609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 132/263] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:17.148459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:17.271488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:17.288578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58317de-1b3d-4e62-9bfe-3e15387886a6 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:17.328637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:17.329618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.330084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.330568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] PATH_INFO: `/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.332498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] RBAC: Authorizing `identity:get_user(user_id=82d4ccaa2efa48fea7d6408ebed2e1e9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:17.334529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:17.336724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 133/264] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:17 2022] GET /identity/v3/users/82d4ccaa2efa48fea7d6408ebed2e1e9 => generated 283 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:17.342400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:17.400767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccd9e2b-1946-4f7a-a39c-79bc433b63e5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:17.456896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d534d6-8e20-4240-bbbb-75208eb06607 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:17.497083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:17.498014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.498472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.498978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.519137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:17.541139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:17.541932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.542296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.542630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.546833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:17.548959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:17.565935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 132/265] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:17 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:17.565935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:17.613135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:17.615188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:17.617035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:17.735073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 134/266] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:17.741304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:17.762151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506cb586-0769-4164-a47e-5f24f14fe4dc None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:17.788645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:17.840186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866f44b0-aea6-40eb-a9d1-92773e96830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:17.840814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f44b0-aea6-40eb-a9d1-92773e96830d None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.841102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f44b0-aea6-40eb-a9d1-92773e96830d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.841384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866f44b0-aea6-40eb-a9d1-92773e96830d None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/411047b615a4444eb365e00a097c521c/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.844175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f44b0-aea6-40eb-a9d1-92773e96830d None admin] RBAC: Authorizing `identity:create_grant(project_id=bede9eab9f294a77abf9b1ae62ce83cb, user_id=411047b615a4444eb365e00a097c521c, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:17.846413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866f44b0-aea6-40eb-a9d1-92773e96830d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:17.852792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e701c552-3237-4f2b-b008-82a50eb3100b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:17.889320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80531705-6f5b-4644-90e4-d419188cc53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:17.889320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531705-6f5b-4644-90e4-d419188cc53c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.889619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531705-6f5b-4644-90e4-d419188cc53c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.889870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80531705-6f5b-4644-90e4-d419188cc53c None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.891049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80531705-6f5b-4644-90e4-d419188cc53c None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:17.892606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80531705-6f5b-4644-90e4-d419188cc53c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:17.894494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 135/267] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:17 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:17.898915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3ad3d-ed4d-46fb-8306-7f6b9fa28d24 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.898915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3ad3d-ed4d-46fb-8306-7f6b9fa28d24 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.898915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3ad3d-ed4d-46fb-8306-7f6b9fa28d24 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.898915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 136/268] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:17.903913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3ad3d-ed4d-46fb-8306-7f6b9fa28d24 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:17.931865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 133/269] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:37:17 2022] PUT /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/411047b615a4444eb365e00a097c521c/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:17.934131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf41c-36fd-4dbc-8c70-40fc4d15aac2 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:17.935225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf41c-36fd-4dbc-8c70-40fc4d15aac2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:17.936007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4acf41c-36fd-4dbc-8c70-40fc4d15aac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:17.964040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e4acf41c-36fd-4dbc-8c70-40fc4d15aac2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:17.967160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e4acf41c-36fd-4dbc-8c70-40fc4d15aac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:18.024179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3ad3d-ed4d-46fb-8306-7f6b9fa28d24 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:18.039896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:18.055623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 134/270] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:18.068193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b33416f-c345-40ed-a102-81c1129518f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:18.069086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33416f-c345-40ed-a102-81c1129518f9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.069375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33416f-c345-40ed-a102-81c1129518f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.069707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33416f-c345-40ed-a102-81c1129518f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.070581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33416f-c345-40ed-a102-81c1129518f9 None admin] RBAC: Adding query filter params (role.id=91979b0781874aef81daab5791316f61, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=82d4ccaa2efa48fea7d6408ebed2e1e9) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:18.070928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33416f-c345-40ed-a102-81c1129518f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:18.072541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b33416f-c345-40ed-a102-81c1129518f9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:18.081005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 137/271] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:17 2022] GET /identity/v3/role_assignments?user.id=82d4ccaa2efa48fea7d6408ebed2e1e9&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=91979b0781874aef81daab5791316f61 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:18.194536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf6f76-c4cc-4a68-870d-b0a7c803117f None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.194873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf6f76-c4cc-4a68-870d-b0a7c803117f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.195075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf6f76-c4cc-4a68-870d-b0a7c803117f None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.196508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 135/272] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:18.202563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa3dc0-6cc8-4cf3-8a25-c559d10b0f05 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.202951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa3dc0-6cc8-4cf3-8a25-c559d10b0f05 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.203235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa3dc0-6cc8-4cf3-8a25-c559d10b0f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.225725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-20aa3dc0-6cc8-4cf3-8a25-c559d10b0f05 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:18.227215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-20aa3dc0-6cc8-4cf3-8a25-c559d10b0f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:18.350666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 138/273] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:18.369605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf6f76-c4cc-4a68-870d-b0a7c803117f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:18.392644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:18.435008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad685-7779-4f90-a3a2-1ee56b45a44e None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.435367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad685-7779-4f90-a3a2-1ee56b45a44e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.435560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaad685-7779-4f90-a3a2-1ee56b45a44e None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.437207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 139/274] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:18.442941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6f63-ff2f-4970-ad1b-14a07d0d04a4 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.443226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6f63-ff2f-4970-ad1b-14a07d0d04a4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.446186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa6f63-ff2f-4970-ad1b-14a07d0d04a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.464701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-fbaa6f63-ff2f-4970-ad1b-14a07d0d04a4 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:18.465993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fbaa6f63-ff2f-4970-ad1b-14a07d0d04a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:18.492843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf6f76-c4cc-4a68-870d-b0a7c803117f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:18.544444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:18.545313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.545663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.546047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] PATH_INFO: `/v3/roles/member` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.552496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 140/275] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:18.561306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:18.568066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:18.568953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:18.569737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 136/276] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:18.573742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6f63-ff2f-4970-ad1b-14a07d0d04a4 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:18.609664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:18.654996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:18.681016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaa6f63-ff2f-4970-ad1b-14a07d0d04a4 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:18.731545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:18.732284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.732703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.733161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.734038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:18.734445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:18.736535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:18.745757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 141/277] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:18.751239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:18.753738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:18.775875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569af7a4-6e90-4ba1-98f3-74ac2e7f2746 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:18.826834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:18.827487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.827775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.828054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.829673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:18.831737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:18.834327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 137/278] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:18.839983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:18.889868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:18.895183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa829043-72d1-4e2d-9d8f-2a001ec9fade None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:18.935698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:18.936976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:18.937481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:18.937942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] PATH_INFO: `/v3/users/4f45d39dff8a464a8aee298135efbf8e` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:18.967879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] RBAC: Authorizing `identity:get_user(user_id=4f45d39dff8a464a8aee298135efbf8e)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:18.969622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:18.971538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 142/279] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:18 2022] GET /identity/v3/users/4f45d39dff8a464a8aee298135efbf8e => generated 293 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:18.980170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:19.001986 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1cfb4a-f505-4cdc-b177-faa66f2e23ab None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:19.037256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:19.038104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:19.038534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:19.039024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:19.039829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:19.041419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:19.098809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa1a455-80e5-44be-b844-432d51c96d34 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:19.128995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:19.129633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:19.129908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:19.130181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:19.142131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:19.147591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:19.151700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 143/280] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:19.152524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:19.163196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 138/281] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:18 2022] POST /identity/v3/users => generated 293 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:19.164600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:19.171431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:19.174545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:19.334027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbb2d13-de77-4257-8b69-c6a677625e69 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:19.344976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57299f37-ffd1-479f-98e5-fd706152fb47 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:19.382669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:19.383477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:19.383865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:19.384288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:19.385161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, user.id=4f45d39dff8a464a8aee298135efbf8e, scope.system=all) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:19.385478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:19.387795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:19.392868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:19.393619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:19.393731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 144/282] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 06:37:19 2022] GET /identity/v3/role_assignments?user.id=4f45d39dff8a464a8aee298135efbf8e&scope.system=all&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:19.393857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:19.394131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:19.402832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:19.402832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:19.402832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:19.408690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 139/283] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:19.418845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:19.549805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:19.570328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f64a5e-b5fa-44b5-9280-4f2b18f1f907 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:19.612144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:19.613171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:19.613700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:19.614173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] PATH_INFO: `/v3/users/4164e05f7a5c40bf87e2dafe140227c8` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:19.615625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] RBAC: Authorizing `identity:get_user(user_id=4164e05f7a5c40bf87e2dafe140227c8)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:19.617217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:19.619245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 145/284] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:19 2022] GET /identity/v3/users/4164e05f7a5c40bf87e2dafe140227c8 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:19.626369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:19.699038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:19.743561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae56c4a0-566a-4524-a4a0-dc7d8f991055 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:19.784667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e3f995-a7ca-44eb-b0d3-83ded582f6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:19.785376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f995-a7ca-44eb-b0d3-83ded582f6c4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:19.785663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f995-a7ca-44eb-b0d3-83ded582f6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:19.785940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3f995-a7ca-44eb-b0d3-83ded582f6c4 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:19.788296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3f995-a7ca-44eb-b0d3-83ded582f6c4 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:19.789773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e3f995-a7ca-44eb-b0d3-83ded582f6c4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:19.791785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 140/285] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:19 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:19.797636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:19.928127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248123e-406b-4f9a-8c5e-64714469086c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:19.977804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5e41ae-8ad4-43e7-af9b-c9d1b0ce2c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:19.978568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e41ae-8ad4-43e7-af9b-c9d1b0ce2c50 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:19.978876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e41ae-8ad4-43e7-af9b-c9d1b0ce2c50 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:19.979154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5e41ae-8ad4-43e7-af9b-c9d1b0ce2c50 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/4164e05f7a5c40bf87e2dafe140227c8/roles/52546a8fb3e040ebbb2ad35152d6f8a9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:19.981197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e41ae-8ad4-43e7-af9b-c9d1b0ce2c50 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede9eab9f294a77abf9b1ae62ce83cb, user_id=4164e05f7a5c40bf87e2dafe140227c8, role_id=52546a8fb3e040ebbb2ad35152d6f8a9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:19.982659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5e41ae-8ad4-43e7-af9b-c9d1b0ce2c50 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:20.064608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 146/286] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:37:19 2022] PUT /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/users/4164e05f7a5c40bf87e2dafe140227c8/roles/52546a8fb3e040ebbb2ad35152d6f8a9 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:20.333349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effff63-a607-4837-978d-81c285e81fac None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:20.333875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effff63-a607-4837-978d-81c285e81fac None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:20.333875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3effff63-a607-4837-978d-81c285e81fac None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:20.335609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 141/287] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:20.341293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cc95-7529-4da4-927b-f5983b1241c7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:20.341787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cc95-7529-4da4-927b-f5983b1241c7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:20.341859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c0cc95-7529-4da4-927b-f5983b1241c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:20.361992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-97c0cc95-7529-4da4-927b-f5983b1241c7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:20.363217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-97c0cc95-7529-4da4-927b-f5983b1241c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:20.365215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:20.442945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 147/288] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:20.837055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effff63-a607-4837-978d-81c285e81fac None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:20.978855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3effff63-a607-4837-978d-81c285e81fac None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:21.025244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:21.030744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:21.031410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.031694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.038094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] PATH_INFO: `/v3/roles/member` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.043328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:21.048634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:21.049494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:21.050290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 142/289] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:21.055879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0cc95-7529-4da4-927b-f5983b1241c7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:21.214296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c0cc95-7529-4da4-927b-f5983b1241c7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:21.269022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:21.269875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.270354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.270820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.271643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:21.272107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:21.273626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:21.279733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:21.288370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 148/290] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:21.294142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:21.478860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ede3f58-b8d5-4a2c-b529-d5d1da6f801a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:21.531777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0234d1-9943-4843-b2c2-3e104a5732d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:21.532857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0234d1-9943-4843-b2c2-3e104a5732d8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.533148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0234d1-9943-4843-b2c2-3e104a5732d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.533421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0234d1-9943-4843-b2c2-3e104a5732d8 None admin] PATH_INFO: `/v3/users/411047b615a4444eb365e00a097c521c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.539486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0234d1-9943-4843-b2c2-3e104a5732d8 None admin] RBAC: Authorizing `identity:get_user(user_id=411047b615a4444eb365e00a097c521c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:21.540941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0234d1-9943-4843-b2c2-3e104a5732d8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:21.542899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 143/291] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:21 2022] GET /identity/v3/users/411047b615a4444eb365e00a097c521c => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:21.548640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:21.700842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731a777-7e45-4817-9137-e86d6a70ab4c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:21.769203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:21.769874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.770163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.770436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.771465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362fd69-e272-49ff-aa85-9f15cf0209ad None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.771755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362fd69-e272-49ff-aa85-9f15cf0209ad None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.772035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9362fd69-e272-49ff-aa85-9f15cf0209ad None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.773637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 144/292] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:21.780014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c3cff-dddd-4e9c-914d-47371e08567f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.780300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c3cff-dddd-4e9c-914d-47371e08567f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.780576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16c3cff-dddd-4e9c-914d-47371e08567f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.827088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a16c3cff-dddd-4e9c-914d-47371e08567f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:21.831037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a16c3cff-dddd-4e9c-914d-47371e08567f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:21.908568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:21.909822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 145/293] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:21.921648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:21.931731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:21.933248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:21.938449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66384f19-ddcf-420c-a51b-0b20bd8f74c6 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.939395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66384f19-ddcf-420c-a51b-0b20bd8f74c6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.939758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66384f19-ddcf-420c-a51b-0b20bd8f74c6 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.941501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 146/294] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:37:21.955871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2dd8b-0544-4c2d-a642-4824353bc2eb None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:21.956253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2dd8b-0544-4c2d-a642-4824353bc2eb None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:21.956606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd2dd8b-0544-4c2d-a642-4824353bc2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:21.981998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7fd2dd8b-0544-4c2d-a642-4824353bc2eb None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:21.983363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7fd2dd8b-0544-4c2d-a642-4824353bc2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:22.058113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 147/295] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:22.058113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9db5e-f462-4325-91ff-e424ac710d92 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.058113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9db5e-f462-4325-91ff-e424ac710d92 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.058113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed9db5e-f462-4325-91ff-e424ac710d92 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.058113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 148/296] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:22.063580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b037e-4997-4c01-8d6f-ebc0cab7a7c1 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.064439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b037e-4997-4c01-8d6f-ebc0cab7a7c1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.064724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b037e-4997-4c01-8d6f-ebc0cab7a7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.085750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-343b037e-4997-4c01-8d6f-ebc0cab7a7c1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:22.087141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-343b037e-4997-4c01-8d6f-ebc0cab7a7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:22.093366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 149/297] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:22.100983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.193286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 149/298] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:22.244679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b037e-4997-4c01-8d6f-ebc0cab7a7c1 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.286474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:22.289718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bf72f8-dd1d-4cc8-a8c1-d1c34ff3a390 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.299150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:22.352845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.353401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.353683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.353961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.355318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:22.356880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:22.358523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 150/299] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:22.364855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.377598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b037e-4997-4c01-8d6f-ebc0cab7a7c1 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.434198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.435515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.435799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.436072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] PATH_INFO: `/v3/roles/member` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.448902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:22.454323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:22.455273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:22.456441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 150/300] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:22.460705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.508459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3331a083-c57b-48d6-a320-7caffba280c6 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.548773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.550223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.550616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.550933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.551679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=411047b615a4444eb365e00a097c521c) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:22.551994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:22.553491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:22.559797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 151/301] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/role_assignments?user.id=411047b615a4444eb365e00a097c521c&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:22.563144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.569383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3336ac72-7ccf-492f-9786-04485a6d3bba None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.581711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:22.598508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:22.608622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.609188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.609468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.609742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.612419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:22.614531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:22.616539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 151/302] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:22.617615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.693454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd129bda-5c40-491f-939b-aef55fe009bf None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.738391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed342a0d-8dec-40cd-9e01-d1ec55edb786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.739024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed342a0d-8dec-40cd-9e01-d1ec55edb786 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.739303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed342a0d-8dec-40cd-9e01-d1ec55edb786 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.739574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed342a0d-8dec-40cd-9e01-d1ec55edb786 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.740239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed342a0d-8dec-40cd-9e01-d1ec55edb786 None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:22.740540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed342a0d-8dec-40cd-9e01-d1ec55edb786 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:22.741932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed342a0d-8dec-40cd-9e01-d1ec55edb786 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:22.744211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed420fa-2d59-4d5b-9e58-a16a8b6647cc None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.752233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 152/303] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:22.753454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cb7e8-cfe6-4660-b512-81e194e3889b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.753736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cb7e8-cfe6-4660-b512-81e194e3889b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.754007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764cb7e8-cfe6-4660-b512-81e194e3889b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.756784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 153/304] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:22.756784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cb7e8-cfe6-4660-b512-81e194e3889b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.792116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.792770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.793061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.793346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.808734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:22.814873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:22.815959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:22.816737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 152/305] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:22.817468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.861474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:22.868647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:22.875941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764cb7e8-cfe6-4660-b512-81e194e3889b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.910460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.911099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.911373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.911643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] PATH_INFO: `/v3/groups` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.912266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:22.913742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:22.923814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b164d-aeaa-4305-9663-fddf24593dae None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:22.957982 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57812ab9-7dbf-4860-83f9-3e1d601d3ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:22.958628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ab9-7dbf-4860-83f9-3e1d601d3ec8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.958951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ab9-7dbf-4860-83f9-3e1d601d3ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.959234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57812ab9-7dbf-4860-83f9-3e1d601d3ec8 None admin] PATH_INFO: `/v3/users/4f45d39dff8a464a8aee298135efbf8e` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.960372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812ab9-7dbf-4860-83f9-3e1d601d3ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=4f45d39dff8a464a8aee298135efbf8e)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:22.961855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57812ab9-7dbf-4860-83f9-3e1d601d3ec8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:22.963471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 153/306] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/users/4f45d39dff8a464a8aee298135efbf8e => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:22.964579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7853e-466d-4b8f-8b8a-770b632d50c1 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:22.964864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7853e-466d-4b8f-8b8a-770b632d50c1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:22.965136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a7853e-466d-4b8f-8b8a-770b632d50c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:22.972347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 154/307] 10.222.0.59 () {60 vars in 1134 bytes} [Wed Aug 24 06:37:22 2022] POST /identity/v3/groups => generated 229 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:22.973439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:22.997900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-21a7853e-466d-4b8f-8b8a-770b632d50c1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:22.999210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-21a7853e-466d-4b8f-8b8a-770b632d50c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:23.087028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 154/308] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:23.087028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7853e-466d-4b8f-8b8a-770b632d50c1 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:23.100127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf22174-7c3d-491a-aaef-2f8eefdbcc14 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:23.138861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:23.147987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:23.148696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:23.148897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:23.149179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:23.149955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:23.150259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:23.152030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:23.162526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 155/309] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:23.169619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:23.197325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:23.225240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a7853e-466d-4b8f-8b8a-770b632d50c1 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:23.262698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:23.263798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:23.264369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:23.264834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] PATH_INFO: `/v3/system/users/4f45d39dff8a464a8aee298135efbf8e/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:23.266658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4f45d39dff8a464a8aee298135efbf8e, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:23.268284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:23.302329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eeceaa-f2c6-47b6-8169-53d9549f40cb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:23.327710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 155/310] 10.222.0.59 () {58 vars in 1334 bytes} [Wed Aug 24 06:37:23 2022] PUT /identity/v3/system/users/4f45d39dff8a464a8aee298135efbf8e/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:23.347077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:23.348237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:23.348742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:23.349269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] PATH_INFO: `/v3/users/b754e31e6897488ea1006ad431fa7021` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:23.366303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:23.373332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] RBAC: Authorizing `identity:get_user(user_id=b754e31e6897488ea1006ad431fa7021)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:23.374974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:23.377004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 156/311] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:23 2022] GET /identity/v3/users/b754e31e6897488ea1006ad431fa7021 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:23.383032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:23.467931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:23.496119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:23.496307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef620ed-1673-42a0-a780-da88ba4d2fcc None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:23.502789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d651f08-efb7-460a-b53a-ef3b9603046d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:23.540916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:23.541563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:23.541755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:23.541864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:23.542113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:23.542357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:23.542642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:23.542957 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:23.543949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] RBAC: Adding query filter params (role.id=52546a8fb3e040ebbb2ad35152d6f8a9, user.id=b754e31e6897488ea1006ad431fa7021, scope.system=all) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:23.544258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:23.546199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:23.552993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 157/312] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 06:37:23 2022] GET /identity/v3/role_assignments?user.id=b754e31e6897488ea1006ad431fa7021&scope.system=all&role.id=52546a8fb3e040ebbb2ad35152d6f8a9 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:23.560642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:23.567851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:23.575591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:23.576383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 156/313] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:23.577070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:23.706126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9a98de-2f3f-4e8f-a2ba-ceea4e58eb38 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:23.746862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:23.747407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:23.747688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:23.747963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:23.748637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:23.748941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:23.750334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:23.756314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:23.760553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 158/314] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:23.765799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:23.872817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58686d91-cb16-4c01-a4a8-233210723f52 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:23.910990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:23.911811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:23.912266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:23.912680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] PATH_INFO: `/v3/users/4164e05f7a5c40bf87e2dafe140227c8` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:23.914181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] RBAC: Authorizing `identity:get_user(user_id=4164e05f7a5c40bf87e2dafe140227c8)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:23.915762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:23.917640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 157/315] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:23 2022] GET /identity/v3/users/4164e05f7a5c40bf87e2dafe140227c8 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:23.924116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:24.029260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e54b20-dd90-439d-9f1e-bca118cae587 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:24.064330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:24.064941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:24.065223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:24.065498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:24.137000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:24.140378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:24.142073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:24.263353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 159/316] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:24.270828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:24.302105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:24.384980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c8ea5-aaa7-47e2-8986-99fe2f491347 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:24.424161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f75d14b-ee63-4068-9d63-6016b0aa436a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:24.424805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75d14b-ee63-4068-9d63-6016b0aa436a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:24.425093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75d14b-ee63-4068-9d63-6016b0aa436a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:24.425379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f75d14b-ee63-4068-9d63-6016b0aa436a None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:24.426524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75d14b-ee63-4068-9d63-6016b0aa436a None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:24.428024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f75d14b-ee63-4068-9d63-6016b0aa436a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:24.429664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 158/317] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:24 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:24.435548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:24.546261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:24.550180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe4a20-9518-421b-af5d-bfe20da5b000 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:24.586359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfc528a-1229-47af-91f2-acd0ab959804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:24.587755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc528a-1229-47af-91f2-acd0ab959804 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:24.588230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc528a-1229-47af-91f2-acd0ab959804 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:24.588696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfc528a-1229-47af-91f2-acd0ab959804 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:24.589625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc528a-1229-47af-91f2-acd0ab959804 None admin] RBAC: Adding query filter params (role.id=52546a8fb3e040ebbb2ad35152d6f8a9, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb, user.id=4164e05f7a5c40bf87e2dafe140227c8) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:24.590126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc528a-1229-47af-91f2-acd0ab959804 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:24.591818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfc528a-1229-47af-91f2-acd0ab959804 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:24.598323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 160/318] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:24 2022] GET /identity/v3/role_assignments?user.id=4164e05f7a5c40bf87e2dafe140227c8&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=52546a8fb3e040ebbb2ad35152d6f8a9 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:25.097311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09d8a7-a715-4e60-9b43-0c4ae6026c76 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.097930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09d8a7-a715-4e60-9b43-0c4ae6026c76 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.097930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09d8a7-a715-4e60-9b43-0c4ae6026c76 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.099398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 159/319] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:25.104663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811b6b-8019-4e04-b037-27b79366ed9c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.104954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811b6b-8019-4e04-b037-27b79366ed9c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.105232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47811b6b-8019-4e04-b037-27b79366ed9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.122998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-47811b6b-8019-4e04-b037-27b79366ed9c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:25.124183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-47811b6b-8019-4e04-b037-27b79366ed9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:25.190180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 161/320] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:25.305052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ad79-333a-4664-8ae4-6ba3593773af None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.305395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ad79-333a-4664-8ae4-6ba3593773af None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.305623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7481ad79-333a-4664-8ae4-6ba3593773af None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.307151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 160/321] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:25.312249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a90d-9ea8-4dd4-aafa-379bd937e783 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.312545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a90d-9ea8-4dd4-aafa-379bd937e783 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.312849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7582a90d-9ea8-4dd4-aafa-379bd937e783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.332696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-7582a90d-9ea8-4dd4-aafa-379bd937e783 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:25.333919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7582a90d-9ea8-4dd4-aafa-379bd937e783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:25.403167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 162/322] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:25.455579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481ad79-333a-4664-8ae4-6ba3593773af None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:25.565243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:25.570886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2315-87c6-40f8-a42a-e472498a4cf7 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.571213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2315-87c6-40f8-a42a-e472498a4cf7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.571467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4f2315-87c6-40f8-a42a-e472498a4cf7 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.573121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 163/323] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:25.577816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7481ad79-333a-4664-8ae4-6ba3593773af None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:25.578449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146354d-3685-419c-b987-8ca576f477c9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.590327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146354d-3685-419c-b987-8ca576f477c9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.590327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6146354d-3685-419c-b987-8ca576f477c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.597849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6146354d-3685-419c-b987-8ca576f477c9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:25.599089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6146354d-3685-419c-b987-8ca576f477c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:25.618436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:25.619107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.619404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.619662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.620793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:25.622358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:25.623379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:25.626849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 161/324] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:25.633704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:25.683732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 164/325] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:25.684485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146354d-3685-419c-b987-8ca576f477c9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:25.751732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e092d7-9919-4e13-838e-b9b8ee332c1f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:25.788888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:25.789503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.789790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.790066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] PATH_INFO: `/v3/groups` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.790701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:25.792167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:25.794463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6146354d-3685-419c-b987-8ca576f477c9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:25.829511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:25.830140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:25.830420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:25.830686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:25.840580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:25.845825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:25.847253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:25.848391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:25.850921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 165/326] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:25.852520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:25.870830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 162/327] 10.222.0.59 () {60 vars in 1134 bytes} [Wed Aug 24 06:37:25 2022] POST /identity/v3/groups => generated 226 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:25.871637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:25.955866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:25.972881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5d3eb0-39dc-427b-a886-a52ddb72a61f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:25.989101 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:26.018950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:26.019890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:26.020182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:26.020457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:26.021139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:26.021444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:26.022890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:26.032984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 166/328] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:26.038839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:26.082441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394afa83-291c-4eb8-b519-2cb46cf3c04d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:26.131460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:26.132278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:26.132564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:26.132836 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:26.144599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:26.145640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:26.151336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:26.158596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:26.159593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 163/329] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:26.160239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:26.175315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac0530e-3299-41ed-b69b-393a8dc420fe None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:26.213199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:26.214177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:26.214663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:26.215186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] PATH_INFO: `/v3/users/4f45d39dff8a464a8aee298135efbf8e` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:26.216577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] RBAC: Authorizing `identity:get_user(user_id=4f45d39dff8a464a8aee298135efbf8e)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:26.218074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:26.220658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 167/330] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:26 2022] GET /identity/v3/users/4f45d39dff8a464a8aee298135efbf8e => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:26.227056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:26.272929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:26.290642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59941be-e1cc-41e6-b3c5-34e965d23463 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:26.340263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:26.341303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:26.342057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:26.342512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:26.343388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] RBAC: Adding query filter params (name=reader) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:26.343828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:26.346126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:26.358356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5519c193-bf98-42a5-89c4-775d18e58cf5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:26.359547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 164/331] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:26.367807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:26.405506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:26.406407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:26.406696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:26.407078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:26.408619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] RBAC: Adding query filter params (role.id=85f11f9cbbe24bfba7dd40522c375e6d, user.id=4f45d39dff8a464a8aee298135efbf8e, scope.system=all) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:26.409140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:26.411479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:26.428797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 168/332] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 06:37:26 2022] GET /identity/v3/role_assignments?user.id=4f45d39dff8a464a8aee298135efbf8e&scope.system=all&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 510 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:26.503869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd818453-d2c7-4aa4-b5d7-b237db682c13 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:26.545623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1cec4-0f39-4386-9ae8-ef5d46328831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:26.546606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1cec4-0f39-4386-9ae8-ef5d46328831 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:26.547065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1cec4-0f39-4386-9ae8-ef5d46328831 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:26.547483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1cec4-0f39-4386-9ae8-ef5d46328831 None admin] PATH_INFO: `/v3/users/b754e31e6897488ea1006ad431fa7021` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:26.551638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1cec4-0f39-4386-9ae8-ef5d46328831 None admin] RBAC: Authorizing `identity:get_user(user_id=b754e31e6897488ea1006ad431fa7021)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:26.553352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1cec4-0f39-4386-9ae8-ef5d46328831 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:26.555851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 165/333] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:26 2022] GET /identity/v3/users/b754e31e6897488ea1006ad431fa7021 => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:26.566176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:26.569212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:26.700023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e243472-0acd-4764-af63-fd94388c95e5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:26.746033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a63725-d58b-4cf2-9e13-8d7ef5062c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:26.747009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a63725-d58b-4cf2-9e13-8d7ef5062c75 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:26.747435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a63725-d58b-4cf2-9e13-8d7ef5062c75 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:26.747872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a63725-d58b-4cf2-9e13-8d7ef5062c75 None admin] PATH_INFO: `/v3/system/users/b754e31e6897488ea1006ad431fa7021/roles/52546a8fb3e040ebbb2ad35152d6f8a9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:26.749550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a63725-d58b-4cf2-9e13-8d7ef5062c75 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b754e31e6897488ea1006ad431fa7021, role_id=52546a8fb3e040ebbb2ad35152d6f8a9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:26.751169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a63725-d58b-4cf2-9e13-8d7ef5062c75 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:26.831354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 169/334] 10.222.0.59 () {58 vars in 1334 bytes} [Wed Aug 24 06:37:26 2022] PUT /identity/v3/system/users/b754e31e6897488ea1006ad431fa7021/roles/52546a8fb3e040ebbb2ad35152d6f8a9 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:28.251450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cca88-f469-476c-ad6b-6aacfb82f30a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:28.252476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cca88-f469-476c-ad6b-6aacfb82f30a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:28.252965 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cca88-f469-476c-ad6b-6aacfb82f30a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:28.254839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 166/335] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:28.259960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99669efe-f654-4470-b5c0-d797c4a7f61e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:28.260846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99669efe-f654-4470-b5c0-d797c4a7f61e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:28.261322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99669efe-f654-4470-b5c0-d797c4a7f61e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:28.291014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7361-fd5b-4e33-9e61-7c89fbe6d7e2 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:28.291320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7361-fd5b-4e33-9e61-7c89fbe6d7e2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:28.291586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3be7361-fd5b-4e33-9e61-7c89fbe6d7e2 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:28.291783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-99669efe-f654-4470-b5c0-d797c4a7f61e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:28.293071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-99669efe-f654-4470-b5c0-d797c4a7f61e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:28.293493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 167/336] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:28.298979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3780f6f-d04f-4806-aa1a-60db445a6a36 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:28.299273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3780f6f-d04f-4806-aa1a-60db445a6a36 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:28.299556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3780f6f-d04f-4806-aa1a-60db445a6a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:28.336322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d3780f6f-d04f-4806-aa1a-60db445a6a36 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:28.337547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d3780f6f-d04f-4806-aa1a-60db445a6a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:28.357895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:28.403152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:28.412165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 170/337] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:28.462525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 168/338] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:28.740003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99669efe-f654-4470-b5c0-d797c4a7f61e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:28.792395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3780f6f-d04f-4806-aa1a-60db445a6a36 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:28.898053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99669efe-f654-4470-b5c0-d797c4a7f61e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:28.956230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3780f6f-d04f-4806-aa1a-60db445a6a36 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:28.958579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:28.959489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:28.959974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:28.960446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:28.976190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:28.981512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:28.982403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:28.983247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:28.991233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 171/339] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:28.997479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:28.998918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:28.999575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:28.999863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.000140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.012552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:29.018226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:29.019205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:29.019988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 169/340] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:29.026474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:29.030910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:29.073689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:29.124199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29129172-0a51-4a39-9c99-c1d1b495603d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:29.143401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4092730b-5cfe-42ed-8de9-22a9e92925ac None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:29.165022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:29.166047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.166535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.167045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.167973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:29.168797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:29.170550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:29.181374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:29.181729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 172/341] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:29.186238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.186238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.186238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.186238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:29.186238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:29.186238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:29.187848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:29.195499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 170/342] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:29.201069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:29.270716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:29.305418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb39ac8-3ea8-44f6-b2d2-d647d9439c88 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:29.317874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f839980-cd46-4ff3-b505-0320f029209c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:29.325615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:29.346441 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:29.347442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.347935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.348523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.363096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:29.363717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.364003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.364383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.430912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:29.432856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:29.447468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:29.449017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:29.545158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 173/343] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:29.550817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:29.552652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:29.577433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:29.615189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 171/344] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:29.619872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:29.669467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a45056-ffc8-436e-9eff-4367059686d4 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:29.787516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a9b58-6507-47e9-a86f-71c61d4ea6bb None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:29.795559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf5294-7839-4865-931d-8ee39fd848f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:29.796481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5294-7839-4865-931d-8ee39fd848f8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.796953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5294-7839-4865-931d-8ee39fd848f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.797459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf5294-7839-4865-931d-8ee39fd848f8 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.798949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf5294-7839-4865-931d-8ee39fd848f8 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:29.801667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf5294-7839-4865-931d-8ee39fd848f8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:29.804560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 174/345] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:29 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:29.805598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25a94d-ce90-41ab-bd46-f94e927da7a6 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.805886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25a94d-ce90-41ab-bd46-f94e927da7a6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.806164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25a94d-ce90-41ab-bd46-f94e927da7a6 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.815078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 175/346] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:29.816383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa232c-f4c0-4896-a3d7-4dc0cec3b56b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.816675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa232c-f4c0-4896-a3d7-4dc0cec3b56b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.816955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baa232c-f4c0-4896-a3d7-4dc0cec3b56b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.852375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:29.853027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:29.853318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:29.853601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:29.854824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:29.856275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:29.857920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 172/347] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:29 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:29.858681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:29.860008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5baa232c-f4c0-4896-a3d7-4dc0cec3b56b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:29.861228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5baa232c-f4c0-4896-a3d7-4dc0cec3b56b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:29.923133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:29.993092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 176/348] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:29.993984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa232c-f4c0-4896-a3d7-4dc0cec3b56b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:30.012922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badeaff9-fd38-48ce-a031-b3fbfd505e4d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:30.036745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:30.066879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:30.067866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.068999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.069480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.079408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:30.081518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:30.083479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 173/349] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:29 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:30.089731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:30.182675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baa232c-f4c0-4896-a3d7-4dc0cec3b56b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:30.227281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de960ec3-1c09-4370-b988-b20e42d502de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:30.227938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960ec3-1c09-4370-b988-b20e42d502de None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.228218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960ec3-1c09-4370-b988-b20e42d502de None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.228490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de960ec3-1c09-4370-b988-b20e42d502de None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.230636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de960ec3-1c09-4370-b988-b20e42d502de None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:30.232131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de960ec3-1c09-4370-b988-b20e42d502de None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:30.233787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 177/350] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:29 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:30.235073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f76fe-5391-4bbf-a721-bc1bd79eab32 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.235361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f76fe-5391-4bbf-a721-bc1bd79eab32 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.235642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f76fe-5391-4bbf-a721-bc1bd79eab32 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.237051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 178/351] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:30.241373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f76fe-5391-4bbf-a721-bc1bd79eab32 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:30.262797 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756f4b24-4c1b-463b-8c85-2d85e7082532 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:30.267111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:30.338850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f80fc0-6db5-40da-b8a2-a002ed69386a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:30.342193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80fc0-6db5-40da-b8a2-a002ed69386a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.342709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80fc0-6db5-40da-b8a2-a002ed69386a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.343282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f80fc0-6db5-40da-b8a2-a002ed69386a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.345225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f80fc0-6db5-40da-b8a2-a002ed69386a None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:30.345773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f80fc0-6db5-40da-b8a2-a002ed69386a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:30.347796 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f80fc0-6db5-40da-b8a2-a002ed69386a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:30.359410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 174/352] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:30 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 260 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:30.361768 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10091bf-4f26-4ae0-80b7-8c38f3df852b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.362917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10091bf-4f26-4ae0-80b7-8c38f3df852b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.363563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10091bf-4f26-4ae0-80b7-8c38f3df852b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.407970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d10091bf-4f26-4ae0-80b7-8c38f3df852b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:30.410797 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d10091bf-4f26-4ae0-80b7-8c38f3df852b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:30.414928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:30.452527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f76fe-5391-4bbf-a721-bc1bd79eab32 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:30.511013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:30.512152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.512715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.513423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.515992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=91979b0781874aef81daab5791316f61, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:30.517128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:30.518946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:30.527163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 179/353] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:30 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=91979b0781874aef81daab5791316f61 => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:30.528389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:30.533157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 175/354] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:30.534321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dcdf0-5c9f-43fa-acf6-9a968334014c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.534620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dcdf0-5c9f-43fa-acf6-9a968334014c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.534955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06dcdf0-5c9f-43fa-acf6-9a968334014c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.536340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 176/355] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:30.542232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2f7c-5faa-46e5-8ba6-bef6b812ee6a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.542569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2f7c-5faa-46e5-8ba6-bef6b812ee6a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.542827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ff2f7c-5faa-46e5-8ba6-bef6b812ee6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.563601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b8ff2f7c-5faa-46e5-8ba6-bef6b812ee6a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:30.564831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b8ff2f7c-5faa-46e5-8ba6-bef6b812ee6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:30.728271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 177/356] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:30.752592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950c8721-f654-4c3e-a2ea-ba28b7654717 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:30.770418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec8c9-1b2e-45ac-a9a9-9043bc2a7f7e None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.771011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec8c9-1b2e-45ac-a9a9-9043bc2a7f7e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.771394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ec8c9-1b2e-45ac-a9a9-9043bc2a7f7e None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.773199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 178/357] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:30.789513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ba3e-30ce-4a24-a8b0-5520fe4de77f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.790041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ba3e-30ce-4a24-a8b0-5520fe4de77f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.790346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372ba3e-30ce-4a24-a8b0-5520fe4de77f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.812242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:30.812930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:30.813274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:30.813552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:30.825268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-5372ba3e-30ce-4a24-a8b0-5520fe4de77f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:30.826522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5372ba3e-30ce-4a24-a8b0-5520fe4de77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:30.834841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:30.840365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:30.841292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:30.842081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 180/358] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:30.849770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:30.863149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:30.873526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:30.933524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 179/359] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:31.016373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53092143-29f3-4041-a462-1a57461ef60e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:31.059208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:31.059834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:31.060118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:31.060397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:31.061071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:31.061373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:31.062823 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:31.071868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 181/360] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:31.077738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372ba3e-30ce-4a24-a8b0-5520fe4de77f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:31.089698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:31.228957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372ba3e-30ce-4a24-a8b0-5520fe4de77f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:31.275897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:31.313565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:31.314199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:31.314487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:31.314779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:31.346749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5c992-fc6b-46db-acae-0f7341f556d8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:31.355143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:31.423117 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:31.423795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:31.424077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:31.424353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:31.429604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:31.432646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:31.440539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:31.449533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:31.450540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 182/361] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:31.452604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:31.567220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542708-ea93-495a-bf9c-944c6ed99b2b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:31.600905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:31.608932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 180/362] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:31.610056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:31.610418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:31.611166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:31.611645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:31.612006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:31.625056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:31.630063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:31.632646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:31.633424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 183/363] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:31.639876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:31.685116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:31.758825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b368f9-3ce2-4f13-8108-376348b920e4 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:31.777742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb1cff-7499-45fe-8c50-0dd458d7c2de None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:31.800175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:31.801187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:31.801704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:31.802182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:31.803112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] RBAC: Adding query filter params (name=reader) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:31.803699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:31.805305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:31.816220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 181/364] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:31.817516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:31.822351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:31.828255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:31.829249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:31.829714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:31.848281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:31.857752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:31.858927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:31.859856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 184/365] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:31.860544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:31.936708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:31.963917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a21d5a-c72c-4624-b38e-26bcafa32c7e None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:31.980805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:32.005342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0d878d-75b7-4346-a81b-147b6cea8741 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.005731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.006622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.007220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.007820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.009855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.012583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.014612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 182/366] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:31 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:32.015801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.052477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.053110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.053395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.053675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.054357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:32.054663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.056096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.068289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 185/367] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:32.069247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.166393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6256d6ba-439d-415c-ba93-1001e5c5d990 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.196891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6c2f7-b391-428f-a36a-e9a16cfc1a41 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.209869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.210918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.211429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.212331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] PATH_INFO: `/v3/users/b754e31e6897488ea1006ad431fa7021` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.213995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] RBAC: Authorizing `identity:get_user(user_id=b754e31e6897488ea1006ad431fa7021)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.214897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:32.216658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.219836 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 183/368] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/users/b754e31e6897488ea1006ad431fa7021 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:32.221309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.242343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.243020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.243302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.243613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.244609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:32.244718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.246320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.257750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 186/369] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:32.258910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.294097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:32.366971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6546bb-e5a7-4245-9785-0e38af97488f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.387911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bad760-0ec7-4547-b498-6b65e64adf17 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.411808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.412868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.414571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.415023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.417162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.418934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.420854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 184/370] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:32.421639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.437969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.439344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.439853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.440387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.489352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:32.517701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.520668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.539652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce81e62-9804-4468-827c-46252675a505 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.558923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:32.579528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.580156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.580443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.580725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.581735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] RBAC: Adding query filter params (role.id=52546a8fb3e040ebbb2ad35152d6f8a9, user.id=b754e31e6897488ea1006ad431fa7021, scope.system=all) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:32.581854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.583302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.598031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 185/371] 10.222.0.59 () {56 vars in 1308 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/role_assignments?user.id=b754e31e6897488ea1006ad431fa7021&scope.system=all&role.id=52546a8fb3e040ebbb2ad35152d6f8a9 => generated 510 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:32.598985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.639097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 187/372] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:32.640301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.742616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:32.773137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8035ba0-68ee-4f62-8567-8d63104537f4 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.774964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be05ed-7dd1-4b1b-b9c0-537ef85e58ad None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:32.815516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.816594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.817105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.817819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.818822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:32.819349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.821262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.825219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:32.825684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:32.825971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:32.826254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:32.830135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 188/373] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:32.834851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:32.887760 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:32.915346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:32.917058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:32.964121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bb1e56-a598-420f-ac03-bf30e73e9877 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.014754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6379f4b-c108-4e27-85c0-290cb292caa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.016373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6379f4b-c108-4e27-85c0-290cb292caa8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.016880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6379f4b-c108-4e27-85c0-290cb292caa8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.017765 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6379f4b-c108-4e27-85c0-290cb292caa8 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.020151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6379f4b-c108-4e27-85c0-290cb292caa8 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:33.020764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6379f4b-c108-4e27-85c0-290cb292caa8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:33.023683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 189/374] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:33.024343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8283-cfd1-4bd6-bb65-e9c7f3538868 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.024449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8283-cfd1-4bd6-bb65-e9c7f3538868 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.025053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b8283-cfd1-4bd6-bb65-e9c7f3538868 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.026342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 190/375] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:33.027859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f416-2ec5-498f-a915-2deac643111d None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.027859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f416-2ec5-498f-a915-2deac643111d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.028143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f416-2ec5-498f-a915-2deac643111d None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.029327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 191/376] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:33.035843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d7b6-8906-4d35-acb4-3e3e6d651ac7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.036029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d7b6-8906-4d35-acb4-3e3e6d651ac7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.036272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161d7b6-8906-4d35-acb4-3e3e6d651ac7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.050320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:33.056468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a161d7b6-8906-4d35-acb4-3e3e6d651ac7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:33.057911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a161d7b6-8906-4d35-acb4-3e3e6d651ac7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:33.066068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 186/377] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:33.067563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.145749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 192/378] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:33.147393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14990-f228-4b72-9686-2096df333938 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.147922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14990-f228-4b72-9686-2096df333938 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.148397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14990-f228-4b72-9686-2096df333938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.171215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-bfa14990-f228-4b72-9686-2096df333938 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:33.172761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:33.172981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bfa14990-f228-4b72-9686-2096df333938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:33.206269 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda48c5e-48fa-41f2-801e-0ed6baf493ff None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.250837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.251529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.252060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.252354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.253526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:33.255628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:33.257846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 187/379] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:33.259253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.269588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 193/380] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:33.271159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14990-f228-4b72-9686-2096df333938 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.380379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939c3bd5-f17c-4864-ad1b-7573aedf9536 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.390437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:33.424102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.426785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.426785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.426785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] PATH_INFO: `/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.426785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c6bc3685d4c718b6ea09aa1a4b7cf)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:33.428854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:33.431183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 188/381] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf => generated 344 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:33.439256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.462481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14990-f228-4b72-9686-2096df333938 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.463164 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:33.520684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.521294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.521575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.521853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.522588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=91979b0781874aef81daab5791316f61, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:33.522949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:33.524394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:33.531186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 194/382] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=91979b0781874aef81daab5791316f61 => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:33.532627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.607510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a77b5-9f9d-4921-8e3d-0c0fd277b8a2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.642875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15210efb-3453-4825-86ca-58d4b5add736 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.678928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:33.686514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.696013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.696013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.696013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.707597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.708268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.708547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.708820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] PATH_INFO: `/v3/groups/632bc9e5d30a46d99e12f433b8ef2016` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.710030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:33.714977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:33.715945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:33.716764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:33.721244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 195/383] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:33.722073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.731392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] RBAC: Authorizing `identity:get_group(group_id=632bc9e5d30a46d99e12f433b8ef2016)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:33.732464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:33.739437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 189/384] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/groups/632bc9e5d30a46d99e12f433b8ef2016 => generated 229 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:33.740474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.858687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:33.861147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f252d9-816b-4287-9e34-14385156be9b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.886188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1f361-5cd1-498c-9049-778ad203fc0e None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:33.909954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.911635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.912307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.913039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.927974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:33.928600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:33.928881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:33.929205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:33.929834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] RBAC: Adding query filter params (name=member) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:33.930186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:33.931695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:33.932092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:33.939426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:33.940387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:33.941381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:33.950968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 196/385] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:33.950968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:33.951225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 190/386] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:33.955064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:34.022442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:34.072554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e3728-938f-4231-ae58-5db43e5c7570 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.084062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bb448a-d870-4fdb-b135-04e7ecdc13c2 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.111580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.112168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.112448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.112722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.113399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:34.113710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.115156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.120710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:34.129293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 191/387] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:34.129293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:34.136322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.136322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.136322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.136322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.136660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] RBAC: Adding query filter params (group.id=632bc9e5d30a46d99e12f433b8ef2016, role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=a64c6bc3685d4c718b6ea09aa1a4b7cf) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:34.136660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.136660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.143941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 197/388] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:33 2022] GET /identity/v3/role_assignments?group.id=632bc9e5d30a46d99e12f433b8ef2016&scope.project.id=a64c6bc3685d4c718b6ea09aa1a4b7cf&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 260 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:34.145157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:34.264205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc75858d-25dd-44e0-88f0-31ed1c0a1a15 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.281269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:34.294926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1af3fe3-d7de-435f-b0f8-3edbec0380eb None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.304271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.305171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.309361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.309361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.309361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.309361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.310883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 198/389] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:34 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:34.317285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:34.352135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.352802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.353089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.353365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.360191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.361683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.363443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 192/390] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:34 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:34.379851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:34.442951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49c4053-b2ad-4038-bc28-f6d75701cfe8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.485122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.485970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.486347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.486717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.488080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.489692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.491924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 199/391] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:34 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:34.498353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:34.548201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:34.563181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:34.625241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae275bb-b451-4b8b-ba01-8bdf41b6308a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.654101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55297bbc-2012-4fba-8e37-2b8af8b22702 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.719177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.720113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.721428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.721901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.725448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.727156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.733729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 193/392] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:34 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:34.745221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:34.746666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa1cfe-6232-4250-942f-3c3414a8d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.749866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1cfe-6232-4250-942f-3c3414a8d96d None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.751916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1cfe-6232-4250-942f-3c3414a8d96d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.752396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa1cfe-6232-4250-942f-3c3414a8d96d None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/91979b0781874aef81daab5791316f61` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.759141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1cfe-6232-4250-942f-3c3414a8d96d None admin] RBAC: Authorizing `identity:create_grant(project_id=433dd2d3979a4228bf1eaa4d46e7a74a, group_id=5b7d9d0ee4ab4805a89ec480312bfa7a, role_id=91979b0781874aef81daab5791316f61)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.761034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa1cfe-6232-4250-942f-3c3414a8d96d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.848581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 200/393] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 06:37:34 2022] PUT /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/91979b0781874aef81daab5791316f61 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:37:34.880424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce3d61-34f2-4524-8163-5a00c9bc3c2f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:34.926471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eda625-80df-4fce-befd-f15bd0dde6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:34.927628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eda625-80df-4fce-befd-f15bd0dde6a4 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:34.928134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eda625-80df-4fce-befd-f15bd0dde6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:34.928626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eda625-80df-4fce-befd-f15bd0dde6a4 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:34.931139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eda625-80df-4fce-befd-f15bd0dde6a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=433dd2d3979a4228bf1eaa4d46e7a74a, group_id=5b7d9d0ee4ab4805a89ec480312bfa7a, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:34.932933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eda625-80df-4fce-befd-f15bd0dde6a4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:34.936806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:35.003086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 194/394] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 06:37:34 2022] PUT /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:35.155314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8896-5507-4f55-9cac-dedf7680dcfc None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:35.155943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8896-5507-4f55-9cac-dedf7680dcfc None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:35.156485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a8896-5507-4f55-9cac-dedf7680dcfc None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:35.158306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 201/395] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:35.164115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6589ba6-5d2a-4fac-919d-a3318c92db97 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:35.164717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6589ba6-5d2a-4fac-919d-a3318c92db97 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:35.165217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6589ba6-5d2a-4fac-919d-a3318c92db97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:35.191476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b6589ba6-5d2a-4fac-919d-a3318c92db97 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:35.194135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b6589ba6-5d2a-4fac-919d-a3318c92db97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:35.289436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 195/396] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:35.658890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a8896-5507-4f55-9cac-dedf7680dcfc None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:35.802082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a8896-5507-4f55-9cac-dedf7680dcfc None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:35.815740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:35.844550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:35.845230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:35.845514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:35.845790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:35.850891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdba07-b789-4a98-b217-12091d858371 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:35.851769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdba07-b789-4a98-b217-12091d858371 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:35.855503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fdba07-b789-4a98-b217-12091d858371 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:35.855503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 196/397] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:37:35.863953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:35.865254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d08c-9c85-4c47-b098-e273aeeb63ee None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:35.865558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d08c-9c85-4c47-b098-e273aeeb63ee None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:35.865839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1644d08c-9c85-4c47-b098-e273aeeb63ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:35.870283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:35.871380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:35.872249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:35.873370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 202/398] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:35.878496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:35.904172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1644d08c-9c85-4c47-b098-e273aeeb63ee None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:35.905451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1644d08c-9c85-4c47-b098-e273aeeb63ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:35.997391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2181f0-72dc-4a57-81b8-f92e2b7b1b8f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:36.005640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 197/399] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:36.035631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:36.036488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.036919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.037371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.038200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:36.038661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:36.040213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:36.050419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 203/400] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:36.055827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d08c-9c85-4c47-b098-e273aeeb63ee None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:36.123140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:36.169430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1644d08c-9c85-4c47-b098-e273aeeb63ee None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:36.206697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:36.207457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.207736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.208080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.209227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:36.210712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:36.214935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 198/401] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:36 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:36.219892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:36.264684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:36.330702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:36.351220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9da1d-0498-4ec5-8ae7-f623c9b9bd1c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:36.400583 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:36.401248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.401535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.401812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.403040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:36.404505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:36.415299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 204/402] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:36 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:36.433760 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:36.492529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde939c-3256-48ec-9f44-a0305cbda2aa None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:36.523719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:36.532228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:36.537708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.537708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.537708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.545352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:36.550585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:36.551523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:36.552291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:36.555117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 199/403] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:36.558072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:36.639917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:36.652986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf0ce12-9cda-43c5-88ce-d5b74b9357d1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:36.669618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e40f13b-6d05-4a22-8e52-d90ea8c0c4a3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:36.707914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:36.708584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.708865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.709134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.709809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:36.710110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:36.713872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:36.720811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 200/404] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:36.726254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:36.751551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b347b9-9c39-4c7c-8055-023162a83f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:36.752260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b347b9-9c39-4c7c-8055-023162a83f65 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.752547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b347b9-9c39-4c7c-8055-023162a83f65 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.752831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b347b9-9c39-4c7c-8055-023162a83f65 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.762522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b347b9-9c39-4c7c-8055-023162a83f65 None admin] RBAC: Authorizing `identity:create_grant(project_id=bede9eab9f294a77abf9b1ae62ce83cb, group_id=5b7d9d0ee4ab4805a89ec480312bfa7a, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:36.764116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b347b9-9c39-4c7c-8055-023162a83f65 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:36.787192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:36.843211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0595f7fb-8221-4c91-addb-cac20bbee329 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:36.857346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 205/405] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 06:37:36 2022] PUT /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:37:36.867451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0579ba-31ee-4f2c-aaf7-6cf2f1fbdcfb None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.867785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0579ba-31ee-4f2c-aaf7-6cf2f1fbdcfb None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.868266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0579ba-31ee-4f2c-aaf7-6cf2f1fbdcfb None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.869903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 206/406] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:37:36.875692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc4b1-9c78-4b39-956d-a8418823793f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.876015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc4b1-9c78-4b39-956d-a8418823793f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.876303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7bc4b1-9c78-4b39-956d-a8418823793f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.895084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:36.895923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:36.896064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:36.896458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:36.897198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3d7bc4b1-9c78-4b39-956d-a8418823793f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:36.898501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:36.898670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3d7bc4b1-9c78-4b39-956d-a8418823793f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:36.900061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:36.906937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 201/407] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:36 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:36.908458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:37.037721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1234eae3-de45-4774-ba4d-b449f1e056c5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:37.047417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 207/408] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:37.052771 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:37.074371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:37.075163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.075449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.075731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.076942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:37.078758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:37.080568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 202/409] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:36 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:37.086857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bc4b1-9c78-4b39-956d-a8418823793f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:37.186300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:37.196702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7bc4b1-9c78-4b39-956d-a8418823793f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:37.241951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:37.242640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.242955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.243238 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/91979b0781874aef81daab5791316f61` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.246348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] RBAC: Authorizing `identity:create_grant(project_id=bede9eab9f294a77abf9b1ae62ce83cb, group_id=5b7d9d0ee4ab4805a89ec480312bfa7a, role_id=91979b0781874aef81daab5791316f61)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:37.247875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:37.315496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 208/410] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 06:37:37 2022] PUT /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb/groups/5b7d9d0ee4ab4805a89ec480312bfa7a/roles/91979b0781874aef81daab5791316f61 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:37.505116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:37.632998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d52083-1ac8-4ea4-a920-b81fc1ff7b96 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:37.675143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c835ba-95db-4912-8af4-69fe1835b4cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:37.675791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c835ba-95db-4912-8af4-69fe1835b4cd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.676077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c835ba-95db-4912-8af4-69fe1835b4cd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.676357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c835ba-95db-4912-8af4-69fe1835b4cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.690886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c835ba-95db-4912-8af4-69fe1835b4cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-43c835ba-95db-4912-8af4-69fe1835b4cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:37.696395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:37.697383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:37.698187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:37.700430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 203/411] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:37.704346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:37.770990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92200-abe7-48ef-9984-eb0d280b8618 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.771310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92200-abe7-48ef-9984-eb0d280b8618 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.771546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c92200-abe7-48ef-9984-eb0d280b8618 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.773178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 204/412] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:37.777897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce8809-7d39-4b86-b350-4e5471a95534 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.778189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce8809-7d39-4b86-b350-4e5471a95534 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.778468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce8809-7d39-4b86-b350-4e5471a95534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.801137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-59ce8809-7d39-4b86-b350-4e5471a95534 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:37.811403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-59ce8809-7d39-4b86-b350-4e5471a95534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:37.846642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:37.847161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89975c7d-30e8-4bd2-8e2d-5393986a24df None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:37.891391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 205/413] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:37.892709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981f98-1a78-4ae3-bd9c-89cc7c3bc084 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.892999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981f98-1a78-4ae3-bd9c-89cc7c3bc084 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.893282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8981f98-1a78-4ae3-bd9c-89cc7c3bc084 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.894826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 206/414] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:37.899939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361299c-191c-4dcd-b4cb-9922dcb47255 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.900503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361299c-191c-4dcd-b4cb-9922dcb47255 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.900683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361299c-191c-4dcd-b4cb-9922dcb47255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.902695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:37.903343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:37.903721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:37.904098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:37.904868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:37.905175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:37.907216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:37.934827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 209/415] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:37.935822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0361299c-191c-4dcd-b4cb-9922dcb47255 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:37.937056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0361299c-191c-4dcd-b4cb-9922dcb47255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:37.941082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:37.970743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:38.096709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd7673-6bc9-41ed-9489-c208b1e1b369 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.109584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 207/416] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:38.138259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:38.138930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:38.139217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:38.139506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] PATH_INFO: `/v3/groups/632bc9e5d30a46d99e12f433b8ef2016` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:38.143496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] RBAC: Authorizing `identity:get_group(group_id=632bc9e5d30a46d99e12f433b8ef2016)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:38.144902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:38.146833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 210/417] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:37 2022] GET /identity/v3/groups/632bc9e5d30a46d99e12f433b8ef2016 => generated 229 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:38.152289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361299c-191c-4dcd-b4cb-9922dcb47255 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:38.204501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:38.291889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:38.313517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28690d47-cab1-474e-bd7c-a7cc99f0089c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.336976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361299c-191c-4dcd-b4cb-9922dcb47255 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.342786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:38.357063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:38.358005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:38.358456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:38.358937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] PATH_INFO: `/v3/roles/member` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:38.380024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:38.385189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:38.386054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:38.386980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:38.392586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 211/418] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:38.398532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:38.410475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:38.411489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:38.411774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:38.412050 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] PATH_INFO: `/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:38.415035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c6bc3685d4c718b6ea09aa1a4b7cf)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:38.416615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:38.419006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 208/419] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:38 2022] GET /identity/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf => generated 344 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:38.425010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:38.513377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee94ecf8-4d17-4061-a562-04a23412390c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.551817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:38.552692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:38.552985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:38.553327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:38.554146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] RBAC: Adding query filter params (name=member) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:38.554484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:38.555913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:38.564985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 212/420] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:38.569745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:38.572191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:38.572306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3bee6e-74f8-4db6-a7e6-3b479177d768 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.609817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:38.610561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:38.610873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:38.611146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] PATH_INFO: `/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf/groups/632bc9e5d30a46d99e12f433b8ef2016/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:38.613108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] RBAC: Authorizing `identity:create_grant(project_id=a64c6bc3685d4c718b6ea09aa1a4b7cf, group_id=632bc9e5d30a46d99e12f433b8ef2016, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:38.614554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:38.690002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59f6e2d-d11f-47d6-8c0c-546ab9b78001 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.706982 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 209/421] 10.222.0.59 () {58 vars in 1442 bytes} [Wed Aug 24 06:37:38 2022] PUT /identity/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf/groups/632bc9e5d30a46d99e12f433b8ef2016/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:37:38.708129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:38.730909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:38.731663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:38.732095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:38.732476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:38.746818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:38.752155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:38.753321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:38.754303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:38.755914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 213/422] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:38.763990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:38.797833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:38.918257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:38.937910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bc56e9-e21e-428e-a67a-5fc9a06e4749 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.973011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e3e9-fde2-4df9-890e-acaecf5b4c70 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:38.978775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9914928d-f0a7-4f14-9ba1-e0995115ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:38.979406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914928d-f0a7-4f14-9ba1-e0995115ad57 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:38.979683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914928d-f0a7-4f14-9ba1-e0995115ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:38.979953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9914928d-f0a7-4f14-9ba1-e0995115ad57 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.012882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:39.013949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.014440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.015035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.016437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:39.016992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.018638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.028399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 214/423] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:39.035454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.074450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914928d-f0a7-4f14-9ba1-e0995115ad57 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.075959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9914928d-f0a7-4f14-9ba1-e0995115ad57 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.111753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:39.143242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d1a77a-0a52-4db9-85b2-337e91c69741 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:39.168542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:39.180350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c592-2963-447c-b228-fd77dc6e898a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:39.181030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c592-2963-447c-b228-fd77dc6e898a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.181383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c592-2963-447c-b228-fd77dc6e898a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.181595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c592-2963-447c-b228-fd77dc6e898a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.194711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 210/424] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:39.196620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4334-4e62-45ad-af2b-5456fbc0dab9 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.197177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4334-4e62-45ad-af2b-5456fbc0dab9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.197655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b4334-4e62-45ad-af2b-5456fbc0dab9 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.199846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 211/425] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:39.205535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b4334-4e62-45ad-af2b-5456fbc0dab9 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.255168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c592-2963-447c-b228-fd77dc6e898a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.256590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c592-2963-447c-b228-fd77dc6e898a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.327284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b4334-4e62-45ad-af2b-5456fbc0dab9 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:39.363255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 215/426] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:39.364532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063639c-df26-432c-bda0-87e0d514eb8f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.364818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063639c-df26-432c-bda0-87e0d514eb8f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.365094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063639c-df26-432c-bda0-87e0d514eb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.366250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:39.372962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:39.374896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.374896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.374896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.376423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.378151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.380632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 212/427] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:39.381844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.384768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2063639c-df26-432c-bda0-87e0d514eb8f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:39.385779 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2063639c-df26-432c-bda0-87e0d514eb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:39.405618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:39.460591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 216/428] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:39.461545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063639c-df26-432c-bda0-87e0d514eb8f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.514797 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144bf35-f7d2-4eb7-a9f2-6681fa02670b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:39.566808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063639c-df26-432c-bda0-87e0d514eb8f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:39.602745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:39.603419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.603543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:39.603724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.603971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.604137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.604404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.604685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] PATH_INFO: `/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.605090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.605851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] RBAC: Authorizing `identity:get_project(project_id=433dd2d3979a4228bf1eaa4d46e7a74a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.606649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.607322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.608552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 217/429] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:39.608945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 213/430] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/projects/433dd2d3979a4228bf1eaa4d46e7a74a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:39.618505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.618652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.660107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:39.755156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:39.799812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae1014-bd08-4470-a59d-67b085e5d795 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:39.800215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98813-b97c-4bcc-8add-bfa80f197c9f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:39.847492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7966b31-fa4a-4894-9cc6-2c7f86dc9824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:39.848248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966b31-fa4a-4894-9cc6-2c7f86dc9824 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.848594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966b31-fa4a-4894-9cc6-2c7f86dc9824 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.848945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7966b31-fa4a-4894-9cc6-2c7f86dc9824 None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.850015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:39.850132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7966b31-fa4a-4894-9cc6-2c7f86dc9824 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.850627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.850944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.851224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.851575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7966b31-fa4a-4894-9cc6-2c7f86dc9824 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.851960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:39.852272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:39.858090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 214/431] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:39.858226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:39.858301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe228-19eb-4dc6-a3d4-c4f054e32283 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:39.858301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe228-19eb-4dc6-a3d4-c4f054e32283 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:39.858301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dbe228-19eb-4dc6-a3d4-c4f054e32283 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:39.858301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 215/432] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:39.858301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe228-19eb-4dc6-a3d4-c4f054e32283 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.866336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 218/433] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 611 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:39.868260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:39.967741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:39.987523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f354cbf-3504-4d49-bcc6-847d59df8bc9 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:39.991533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dbe228-19eb-4dc6-a3d4-c4f054e32283 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:40.043742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9a1d8-f5dd-433d-890b-bad67dd68ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.044405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a1d8-f5dd-433d-890b-bad67dd68ba4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.044665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a1d8-f5dd-433d-890b-bad67dd68ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.044942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9a1d8-f5dd-433d-890b-bad67dd68ba4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.045832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9a1d8-f5dd-433d-890b-bad67dd68ba4 None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=91979b0781874aef81daab5791316f61, scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:40.046149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9a1d8-f5dd-433d-890b-bad67dd68ba4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:40.047286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.048233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.048429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9a1d8-f5dd-433d-890b-bad67dd68ba4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:40.048888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.049338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.052278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:40.058704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 219/434] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=433dd2d3979a4228bf1eaa4d46e7a74a&role.id=91979b0781874aef81daab5791316f61 => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:40.060421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846693d-10e9-40da-aaa9-6ca7b1eacd54 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.060709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846693d-10e9-40da-aaa9-6ca7b1eacd54 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.060989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9846693d-10e9-40da-aaa9-6ca7b1eacd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.065948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:40.071634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:40.079712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:40.080600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 216/435] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:40.082639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:40.090912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9846693d-10e9-40da-aaa9-6ca7b1eacd54 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:40.092326 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9846693d-10e9-40da-aaa9-6ca7b1eacd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:40.175671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 220/436] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:40.204847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b856d6-851d-40ba-8cb1-7c175edd0eaf None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:40.242329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.242991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.243273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.243547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.244217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] RBAC: Adding query filter params (name=member) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:40.244520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:40.245880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:40.257000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 217/437] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:37:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:40.260113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846693d-10e9-40da-aaa9-6ca7b1eacd54 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:40.355315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:40.384813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9846693d-10e9-40da-aaa9-6ca7b1eacd54 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:40.421285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.422498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.422810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.423083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.479206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:40.502494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:40.504636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:40.558716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:40.601405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:40.621119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9197b2-a50c-42c5-a85b-478e292bea2b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:40.631686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 221/438] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:40.638204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:40.666807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.667756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.668301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.668581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.684911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:40.691313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:40.692277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:40.693074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 218/439] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:40.699955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:40.777048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc4c690-5fc2-4a11-9dd2-935291351a0a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:40.825870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.826514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.827827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.827827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.828437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:40.830151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:40.831971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 222/440] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:40 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:40.838945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:40.842286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92a506f-9f05-49f2-9ee9-6ed1191e287d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:40.867171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:40.893061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:40.901440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.902255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.902853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.903956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.904161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:40.904478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:40.906469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:40.916036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 219/441] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:40.922338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:40.952757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46960e27-3538-45fb-b08e-84c3daad55c3 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:40.989419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f24848-b01e-425e-8807-52670b477bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:40.990079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24848-b01e-425e-8807-52670b477bc3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.990324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24848-b01e-425e-8807-52670b477bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.990602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f24848-b01e-425e-8807-52670b477bc3 None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.991756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24848-b01e-425e-8807-52670b477bc3 None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:40.993199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f24848-b01e-425e-8807-52670b477bc3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:40.994774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 223/442] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:40 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:40.995911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a814-486a-4684-ac7c-0b25269c1d8b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:40.996200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a814-486a-4684-ac7c-0b25269c1d8b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:40.996478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3a814-486a-4684-ac7c-0b25269c1d8b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:40.997883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 224/443] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:41.002454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3a814-486a-4684-ac7c-0b25269c1d8b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:41.023718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0addf6c4-1101-4192-b6ed-f295cd9015b8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:41.057925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:41.058580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.058887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.059174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.101870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3a814-486a-4684-ac7c-0b25269c1d8b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:41.103942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:41.119464 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:41.126415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:41.133391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:41.137717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0e5444-e548-441f-85db-5aba9bd0dbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:41.138332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5444-e548-441f-85db-5aba9bd0dbe3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.138606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5444-e548-441f-85db-5aba9bd0dbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.138917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0e5444-e548-441f-85db-5aba9bd0dbe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.139654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5444-e548-441f-85db-5aba9bd0dbe3 None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=85f11f9cbbe24bfba7dd40522c375e6d, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:41.139964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5444-e548-441f-85db-5aba9bd0dbe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:41.141508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0e5444-e548-441f-85db-5aba9bd0dbe3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:41.147691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 225/444] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:41 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=85f11f9cbbe24bfba7dd40522c375e6d => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:41.148972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbfac-65f8-411b-85dc-aeb013c8ea09 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.155518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbfac-65f8-411b-85dc-aeb013c8ea09 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.155518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fcbfac-65f8-411b-85dc-aeb013c8ea09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.178907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-46fcbfac-65f8-411b-85dc-aeb013c8ea09 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:41.180426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-46fcbfac-65f8-411b-85dc-aeb013c8ea09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:41.253743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 220/445] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 24 06:37:41.259864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:41.283053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 226/446] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:41.348504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:41.369455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946b702b-f2a9-4e28-b57a-9c36ec89f8c1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:41.404282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:41.404835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.405120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.405398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] PATH_INFO: `/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.406627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] RBAC: Authorizing `identity:get_project(project_id=bede9eab9f294a77abf9b1ae62ce83cb)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:41.408109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:41.409756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 221/447] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:41 2022] GET /identity/v3/projects/bede9eab9f294a77abf9b1ae62ce83cb => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:41.415506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcbfac-65f8-411b-85dc-aeb013c8ea09 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:41.524699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fcbfac-65f8-411b-85dc-aeb013c8ea09 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:41.537035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:41.549516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:41.563701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:41.564353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.564646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.564929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] PATH_INFO: `/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.566414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] RBAC: Authorizing `identity:get_group(group_id=5b7d9d0ee4ab4805a89ec480312bfa7a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:41.568247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:41.569933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 227/448] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:41 2022] GET /identity/v3/groups/5b7d9d0ee4ab4805a89ec480312bfa7a => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:41.575731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:41.660699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d105c2ce-ed08-4576-b9c9-0edc76572987 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:41.683256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa314f9-7143-49d4-98ab-850f6cc8ab0c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:41.700216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:41.700857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.701141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.701419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.712379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:41.717413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:41.718988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:41.723599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 222/449] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:37:41.725699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:41.739056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:41.740003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.740405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.740613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:41.740853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.741688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] RBAC: Adding query filter params (group.id=5b7d9d0ee4ab4805a89ec480312bfa7a, role.id=91979b0781874aef81daab5791316f61, scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:41.742090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:41.743888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:41.750394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 228/450] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:41 2022] GET /identity/v3/role_assignments?group.id=5b7d9d0ee4ab4805a89ec480312bfa7a&scope.project.id=bede9eab9f294a77abf9b1ae62ce83cb&role.id=91979b0781874aef81daab5791316f61 => generated 611 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:37:41.841270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9218261-a794-463e-8e00-f0488b7c23e2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:41.879332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:41.879999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:41.880236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:41.880513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:41.881218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:41.881524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:41.882942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:41.893108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 223/451] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:41.898598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:41.948195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:42.014847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8550d92-a00e-44ae-ae35-3645885a4d5b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:42.052483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:42.053093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:42.053372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:42.053643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:42.120719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:42.122181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:42.161911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:42.217476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 229/452] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:42.223814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:42.286994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:42.321188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73efeabb-e77b-4b07-9109-5832e79727e0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:42.354545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:42.355207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:42.355489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:42.355763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] PATH_INFO: `/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:42.356891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] RBAC: Authorizing `identity:get_project(project_id=a64c6bc3685d4c718b6ea09aa1a4b7cf)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:42.358376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:42.360090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 224/453] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:37:42 2022] GET /identity/v3/projects/a64c6bc3685d4c718b6ea09aa1a4b7cf => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:42.365778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:42.465313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b842a42d-a4e7-47ce-b66b-ca0b198370e8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:42.497915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bade67c-8ebc-4c39-b724-8e8fd88c6d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:42.498479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade67c-8ebc-4c39-b724-8e8fd88c6d38 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:42.498786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade67c-8ebc-4c39-b724-8e8fd88c6d38 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:42.499070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bade67c-8ebc-4c39-b724-8e8fd88c6d38 None admin] PATH_INFO: `/v3/groups/632bc9e5d30a46d99e12f433b8ef2016` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:42.500718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bade67c-8ebc-4c39-b724-8e8fd88c6d38 None admin] RBAC: Authorizing `identity:get_group(group_id=632bc9e5d30a46d99e12f433b8ef2016)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:42.502156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bade67c-8ebc-4c39-b724-8e8fd88c6d38 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:42.503751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 230/454] 10.222.0.59 () {56 vars in 1180 bytes} [Wed Aug 24 06:37:42 2022] GET /identity/v3/groups/632bc9e5d30a46d99e12f433b8ef2016 => generated 229 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:42.509625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:42.605188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234fb6d-4fe5-461f-ab03-56dce2ed0f88 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:42.637023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea2612f-6d15-4904-85ba-2258a83e1a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:42.637619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2612f-6d15-4904-85ba-2258a83e1a8b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:42.637902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2612f-6d15-4904-85ba-2258a83e1a8b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:42.638196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea2612f-6d15-4904-85ba-2258a83e1a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:42.638932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2612f-6d15-4904-85ba-2258a83e1a8b None admin] RBAC: Adding query filter params (group.id=632bc9e5d30a46d99e12f433b8ef2016, role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=a64c6bc3685d4c718b6ea09aa1a4b7cf) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:42.639256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2612f-6d15-4904-85ba-2258a83e1a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:42.641263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea2612f-6d15-4904-85ba-2258a83e1a8b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:42.643978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:42.647107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 225/455] 10.222.0.59 () {56 vars in 1376 bytes} [Wed Aug 24 06:37:42 2022] GET /identity/v3/role_assignments?group.id=632bc9e5d30a46d99e12f433b8ef2016&scope.project.id=a64c6bc3685d4c718b6ea09aa1a4b7cf&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:44.988894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f0f4c-f19f-43cb-a89b-c140260a1ec8 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:44.989385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f0f4c-f19f-43cb-a89b-c140260a1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:44.989385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f0f4c-f19f-43cb-a89b-c140260a1ec8 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:44.990995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 231/456] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:44.996378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba441b-d26c-4247-920c-e95f2acd21c9 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:44.996816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba441b-d26c-4247-920c-e95f2acd21c9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:44.996994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba441b-d26c-4247-920c-e95f2acd21c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.024085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f9ba441b-d26c-4247-920c-e95f2acd21c9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:45.025291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f9ba441b-d26c-4247-920c-e95f2acd21c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:45.125901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 226/457] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:45.209774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b7f6b-e409-42a2-bdd3-3401f71731d4 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:45.209774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b7f6b-e409-42a2-bdd3-3401f71731d4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:45.209774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b7f6b-e409-42a2-bdd3-3401f71731d4 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.209774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 232/458] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:45.215893 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde3b7-fd9b-433d-9dd4-871692a6ca7b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:45.216195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde3b7-fd9b-433d-9dd4-871692a6ca7b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:45.216480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacde3b7-fd9b-433d-9dd4-871692a6ca7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.241588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-bacde3b7-fd9b-433d-9dd4-871692a6ca7b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:45.242753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bacde3b7-fd9b-433d-9dd4-871692a6ca7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:45.346051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 227/459] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:45.456832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5a53-2805-43f0-969c-00d2d82290e5 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:45.456832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5a53-2805-43f0-969c-00d2d82290e5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:45.456832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d5a53-2805-43f0-969c-00d2d82290e5 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.457494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 233/460] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:45.462214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d33d7-e5af-4d29-83c5-0c6634055e90 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:45.462506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d33d7-e5af-4d29-83c5-0c6634055e90 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:45.462808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5d33d7-e5af-4d29-83c5-0c6634055e90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.484854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7f5d33d7-e5af-4d29-83c5-0c6634055e90 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:45.486055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7f5d33d7-e5af-4d29-83c5-0c6634055e90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:45.565244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:45.577405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 228/461] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:45.622924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d5a53-2805-43f0-969c-00d2d82290e5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:45.646798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:45.748664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ccfc-7c5f-4f98-beb8-8b549287c4cf None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:45.748955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ccfc-7c5f-4f98-beb8-8b549287c4cf None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:45.749431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad7ccfc-7c5f-4f98-beb8-8b549287c4cf None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.751956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 229/462] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:45.760008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892967c-fa15-47ed-82c8-fb4a5df4d308 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:45.760492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892967c-fa15-47ed-82c8-fb4a5df4d308 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:45.760952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d892967c-fa15-47ed-82c8-fb4a5df4d308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.786209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d5a53-2805-43f0-969c-00d2d82290e5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:45.791475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d892967c-fa15-47ed-82c8-fb4a5df4d308 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:45.793156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d892967c-fa15-47ed-82c8-fb4a5df4d308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:45.825191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:45.825836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:45.826265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:45.826801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:45.840245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:45.842001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:45.858608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:45.859577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:45.860422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:45.860422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:45.860422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:45.862402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 234/463] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:45.863249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:45.877946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 230/464] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:45.879196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892967c-fa15-47ed-82c8-fb4a5df4d308 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:45.947590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:45.998650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045d8817-c214-4587-bda3-a87dbe93ce77 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.002657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d892967c-fa15-47ed-82c8-fb4a5df4d308 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.038491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:46.040051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.040698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.040978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.041251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.055792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.056405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.057237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.057341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.057809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.058279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.059499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:46.060361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.062432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:46.075886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:46.076809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:46.078276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:46.078276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:46.078276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:46.080661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 231/466] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:46.081790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.082322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 235/466] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:46.083256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.201315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e5ad32-92d2-49d2-a56b-bc2074057e19 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.214944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55da6b-4e20-41d4-8dd8-4cde1e771f3c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.231860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:46.240792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.241479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.247855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.247855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.254282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.254788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.254933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.255216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.255535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.256184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:46.256398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.256490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.258190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:46.271375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:46.272315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:46.273272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:46.273272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:46.273272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:46.273272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 232/467] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:46.273936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.283172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 236/468] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:46.284089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.313857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:46.390327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548440c-72ea-4631-b816-1398c8804f21 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.390502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7921ee-8621-4860-98e2-0984bdb0374f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.429640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.430267 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.430546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.430856 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.431524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.432601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.432976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.433245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.433531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.433810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.447499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.449020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:46.466109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:46.467257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:46.468892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:46.468892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:46.468892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:46.468892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 237/469] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:46.468892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.508239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:46.548853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 233/470] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:46 2022] POST /identity/v3/users => generated 246 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:46.549670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.620094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccbd877-97ca-469e-9cb7-21376a37fb95 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.669773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.671248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.671755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.672295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.673225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:46.673733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.675897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.701144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 238/471] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:46.701144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.717445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:46.734207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4c3788-8f3a-4abb-a0e8-d77fdee68373 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.788701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218c744-9861-4d1d-b7e6-df65e029d0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.789432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c744-9861-4d1d-b7e6-df65e029d0fc None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.789877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c744-9861-4d1d-b7e6-df65e029d0fc None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.790313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218c744-9861-4d1d-b7e6-df65e029d0fc None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.791144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218c744-9861-4d1d-b7e6-df65e029d0fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.792980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218c744-9861-4d1d-b7e6-df65e029d0fc None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.811606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:46.827146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e932df-15f9-46db-9dec-b581fcc71be7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:46.863751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:46.864362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.864645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.864924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.865571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:46.865877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:46.867326 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:46.879417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 239/472] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:46.880261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:46.980035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 234/473] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:46 2022] POST /identity/v3/users => generated 248 bytes in 430 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:46.981434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1381188-b28d-4ce9-8ff4-f8a48c0cff91 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:46.981780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1381188-b28d-4ce9-8ff4-f8a48c0cff91 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:46.982092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1381188-b28d-4ce9-8ff4-f8a48c0cff91 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:46.991065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 235/474] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:46.991065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1381188-b28d-4ce9-8ff4-f8a48c0cff91 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:47.008277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf8182-856f-4adc-9c81-9e24d6a9c0df None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:47.061060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07558c73-668f-404b-902f-616c0f21702e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:47.062348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558c73-668f-404b-902f-616c0f21702e None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:47.062835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558c73-668f-404b-902f-616c0f21702e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:47.063836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07558c73-668f-404b-902f-616c0f21702e None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:47.064740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07558c73-668f-404b-902f-616c0f21702e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:47.066535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07558c73-668f-404b-902f-616c0f21702e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:47.146600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1381188-b28d-4ce9-8ff4-f8a48c0cff91 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:47.158709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 240/475] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:46 2022] POST /identity/v3/users => generated 248 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:47.161388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29f4f6-4d17-4ff1-8e21-bcaf34bf24e8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:47.161388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29f4f6-4d17-4ff1-8e21-bcaf34bf24e8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:47.161388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29f4f6-4d17-4ff1-8e21-bcaf34bf24e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:47.168972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:47.189770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ee29f4f6-4d17-4ff1-8e21-bcaf34bf24e8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:47.191717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ee29f4f6-4d17-4ff1-8e21-bcaf34bf24e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:47.198161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:47.199035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:47.199423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:47.199807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:47.200595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:47.202964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:47.287468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:47.297194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 236/476] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:46 2022] POST /identity/v3/users => generated 249 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:47.302980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 241/477] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:47.599011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:47.715655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c66f6e9-1533-4bff-9b25-ea405d151399 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:47.754115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:47.755202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:47.755685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:47.756195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:47.757066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:47.758747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:47.799745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.sql.core [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 06:37:47.799745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 06:37:47.799745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [parameters: {'id': '89ac6a353fed44438efa085cc515bceb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 06:37:47.799745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93391) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application conn.query(q) Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result.read() Aug 24 06:37:47.819358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return ref.to_dict() Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 06:37:47.821750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application next(self.gen) Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application yield resource Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application next(self.gen) Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise self.value Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application session.commit() Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 06:37:47.822651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.session.flush() Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application compat.raise_( Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 06:37:47.823549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 06:37:47.824414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application conn.query(q) Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result.read() Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 06:37:47.825252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [parameters: {'id': '89ac6a353fed44438efa085cc515bceb', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:47.826020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 24 06:37:47.826826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:47.828127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 237/478] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 06:37:47 2022] POST /identity/v3/roles => generated 144 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:47.828248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29f4f6-4d17-4ff1-8e21-bcaf34bf24e8 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:47.964831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29f4f6-4d17-4ff1-8e21-bcaf34bf24e8 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:48.007161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:48.012067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f966f8c-3806-4c9c-a311-e80acfd98b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:48.012705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f966f8c-3806-4c9c-a311-e80acfd98b09 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:48.012988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f966f8c-3806-4c9c-a311-e80acfd98b09 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:48.013262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f966f8c-3806-4c9c-a311-e80acfd98b09 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:48.031629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f966f8c-3806-4c9c-a311-e80acfd98b09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-5f966f8c-3806-4c9c-a311-e80acfd98b09 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:48.036361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:48.037225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:48.037994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 242/479] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:37:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:48.043688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:48.139795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:48.195528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe6ce84-93ff-4670-bdde-ebe317051665 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:48.245918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a41650-ad8d-46c3-af80-b74ace8946f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:48.246464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41650-ad8d-46c3-af80-b74ace8946f8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:48.246747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41650-ad8d-46c3-af80-b74ace8946f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:48.247048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a41650-ad8d-46c3-af80-b74ace8946f8 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:48.247733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a41650-ad8d-46c3-af80-b74ace8946f8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:48.248038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a41650-ad8d-46c3-af80-b74ace8946f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:48.249533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a41650-ad8d-46c3-af80-b74ace8946f8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:48.258290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 238/480] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:48.831161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ae62b-0aa2-451a-9b00-77f1c1a13ef7 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:48.831556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ae62b-0aa2-451a-9b00-77f1c1a13ef7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:48.831730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7ae62b-0aa2-451a-9b00-77f1c1a13ef7 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:48.833526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 243/481] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:48.839722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805257c-b0e7-49e4-aec3-50c222b865a4 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:48.840027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805257c-b0e7-49e4-aec3-50c222b865a4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:48.840292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805257c-b0e7-49e4-aec3-50c222b865a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:48.864586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c805257c-b0e7-49e4-aec3-50c222b865a4 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:48.865935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c805257c-b0e7-49e4-aec3-50c222b865a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:48.954069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 239/482] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:49.277085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ae62b-0aa2-451a-9b00-77f1c1a13ef7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:49.399297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f655-4654-4fa5-a671-7791e3f00f5a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:49.400312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f655-4654-4fa5-a671-7791e3f00f5a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:49.400791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1f655-4654-4fa5-a671-7791e3f00f5a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:49.402576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 240/483] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:49.409072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb623-e829-4459-9f36-2004feffe138 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:49.409353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb623-e829-4459-9f36-2004feffe138 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:49.409631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7cb623-e829-4459-9f36-2004feffe138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:49.413177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7ae62b-0aa2-451a-9b00-77f1c1a13ef7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:49.437423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-9a7cb623-e829-4459-9f36-2004feffe138 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:49.438637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9a7cb623-e829-4459-9f36-2004feffe138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:49.480807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9579c014-8c1f-412b-a2ea-dca60f3afc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:49.481825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579c014-8c1f-412b-a2ea-dca60f3afc63 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:49.482300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579c014-8c1f-412b-a2ea-dca60f3afc63 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:49.482787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9579c014-8c1f-412b-a2ea-dca60f3afc63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:49.506791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:49.517911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 241/484] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:49.524273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9579c014-8c1f-412b-a2ea-dca60f3afc63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-9579c014-8c1f-412b-a2ea-dca60f3afc63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:49.532393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:49.534206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:49.535483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:49.536171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 244/485] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:49.541283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb623-e829-4459-9f36-2004feffe138 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:49.602968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72201-6987-4449-9b6c-0982d0ff5828 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:49.603324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72201-6987-4449-9b6c-0982d0ff5828 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:49.603540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d72201-6987-4449-9b6c-0982d0ff5828 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:49.605883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 245/486] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:49.614660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e300de-b6d8-49fd-a6e9-9627b6b20323 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:49.615020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e300de-b6d8-49fd-a6e9-9627b6b20323 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:49.615308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e300de-b6d8-49fd-a6e9-9627b6b20323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:49.642727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-93e300de-b6d8-49fd-a6e9-9627b6b20323 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:49.644487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-93e300de-b6d8-49fd-a6e9-9627b6b20323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:49.702110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:49.720918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7cb623-e829-4459-9f36-2004feffe138 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:49.725069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 246/487] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:37:49.784744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:49.785285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:49.785571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:49.785862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:49.786561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:49.786889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:49.788284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:49.803372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 242/488] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:49.809013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e300de-b6d8-49fd-a6e9-9627b6b20323 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:49.851527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:49.984260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:49.986911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e300de-b6d8-49fd-a6e9-9627b6b20323 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.026315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37ca8c6-9d3b-4a70-b1d3-012584763919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.026967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca8c6-9d3b-4a70-b1d3-012584763919 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.028150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca8c6-9d3b-4a70-b1d3-012584763919 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.028150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37ca8c6-9d3b-4a70-b1d3-012584763919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.041046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ca8c6-9d3b-4a70-b1d3-012584763919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:50.042434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37ca8c6-9d3b-4a70-b1d3-012584763919 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:50.044344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e94ee74-cde2-45ff-9c25-d4d13e7cc2a3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-e37ca8c6-9d3b-4a70-b1d3-012584763919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:50.059740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:50.060725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:50.061613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:50.061613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:50.061613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:50.061613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 247/489] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:50.062672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf35e2-46fd-4cba-b5e6-c471baad466b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.062672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf35e2-46fd-4cba-b5e6-c471baad466b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.062672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbf35e2-46fd-4cba-b5e6-c471baad466b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.064099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 248/490] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:50.064666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf35e2-46fd-4cba-b5e6-c471baad466b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.094147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af4aeba-bbd9-4311-bc6e-e723944d41bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.094805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4aeba-bbd9-4311-bc6e-e723944d41bd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.095090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4aeba-bbd9-4311-bc6e-e723944d41bd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.095372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af4aeba-bbd9-4311-bc6e-e723944d41bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.103262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:50.108609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af4aeba-bbd9-4311-bc6e-e723944d41bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-7af4aeba-bbd9-4311-bc6e-e723944d41bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:50.114245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:50.120299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 243/491] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:50.121139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949ad2-4831-4ad6-8d76-a4cddddae0ae None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.121869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949ad2-4831-4ad6-8d76-a4cddddae0ae None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.121869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b949ad2-4831-4ad6-8d76-a4cddddae0ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.137833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-4b949ad2-4831-4ad6-8d76-a4cddddae0ae None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:50.139068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4b949ad2-4831-4ad6-8d76-a4cddddae0ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:50.206649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbf35e2-46fd-4cba-b5e6-c471baad466b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.220235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 244/492] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:50.221325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949ad2-4831-4ad6-8d76-a4cddddae0ae None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.265102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.266024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.266509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.266995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.269027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:50.282504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:50.290077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:50.290994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:50.291813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:50.292424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 249/493] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:50.293511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.335553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b949ad2-4831-4ad6-8d76-a4cddddae0ae None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.370964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.371582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.371926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.372204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.372856 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:50.373199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:50.375322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:50.387880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 245/494] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:50.388828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.416860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:50.428020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a10cf3e-607d-41f3-b0fc-5f57323188af None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.471424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.472409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.472886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.473804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.474817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:50.475669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:50.477605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:50.493405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 250/495] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:50.493405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.502062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:50.507923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883429b0-f438-42a1-8027-0b5edddb3bde None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.546965 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.547591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.547876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.548156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.548835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:50.549142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:50.550569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:50.559256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 246/496] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:50.560079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.622778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2940a-0488-4973-80c0-d6a83d8e229d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.668788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.669436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.669718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.669993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.679005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:50.680496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:50.688601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6654e699-ad1b-41e3-9a98-ac77e9246452 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:50.697124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:50.698090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 251/497] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:50.703892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.724843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:50.738907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.739669 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.740028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.740383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.752660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:50.754144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:50.775758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:50.776909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:50.777941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:50.777941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:50.777941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:50.777941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 247/498] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:50.780570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.807049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:50.829322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa40ae-fe01-412c-bd83-e08aa481ac75 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.870529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.871210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.871490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.871771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.884200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:50.889358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:50.890228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:50.891042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 252/499] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:50.891715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.903661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc06bcfa-270e-4dd7-949b-f2bff98247ff None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:50.943220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:50.943876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:50.944156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:50.944433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:50.956037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:50.957509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:50.972911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:50.974134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:50.975027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:50.975027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:50.975027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:50.975027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 248/500] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:50.975607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:50.981112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.004704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad5e44e-749c-4d30-a6d2-5c02ceaccc8f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.040033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.040658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.041282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.041564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.041842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.042856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:51.043169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.044603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.076576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50c9483-ee00-48c8-99c2-cdb37c003f4a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.081940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 253/501] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:51.082824 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.114377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935dc51-e761-4701-98f3-9b1b9bd536a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.115022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935dc51-e761-4701-98f3-9b1b9bd536a2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.115311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935dc51-e761-4701-98f3-9b1b9bd536a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.115592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935dc51-e761-4701-98f3-9b1b9bd536a2 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.116240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935dc51-e761-4701-98f3-9b1b9bd536a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:51.116549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935dc51-e761-4701-98f3-9b1b9bd536a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.117935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935dc51-e761-4701-98f3-9b1b9bd536a2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.129605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 249/502] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:51.130896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f48ca-1cac-4c89-ae96-ba9c105f2ce4 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.131188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f48ca-1cac-4c89-ae96-ba9c105f2ce4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.131472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f48ca-1cac-4c89-ae96-ba9c105f2ce4 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.132676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 250/503] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:51.133375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f48ca-1cac-4c89-ae96-ba9c105f2ce4 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.183088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d1b67-6438-45f9-a0df-ba5fd8bb5ff4 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.217220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.218400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.218681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.218984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.219663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:51.219972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.221383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.222849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.230197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 254/504] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:51.231138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.237963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f48ca-1cac-4c89-ae96-ba9c105f2ce4 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.263171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.275141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.275755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.280829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.280829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.280829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:51.280829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.280829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.294950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 251/505] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:51.295978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.340574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e713a2d-8099-429b-a0e6-b10a156e80e7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.376332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.376955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.377240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.377519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.398933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1276716-80d3-4162-b3db-4c95c9e2c7a9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.431963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e5075-66cc-4495-bd1b-2036f305849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.432591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5075-66cc-4495-bd1b-2036f305849c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.432958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5075-66cc-4495-bd1b-2036f305849c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.433147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e5075-66cc-4495-bd1b-2036f305849c None admin] PATH_INFO: `/v3/users/glance` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.439998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.441265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e5075-66cc-4495-bd1b-2036f305849c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.442730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e5075-66cc-4495-bd1b-2036f305849c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.446490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.448026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e22e5075-66cc-4495-bd1b-2036f305849c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:51.456041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:51.457146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:51.458056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 252/506] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:51.458608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1fe6-d2e6-47f2-825e-9fe410a67ab6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.458672 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1fe6-d2e6-47f2-825e-9fe410a67ab6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.458966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d1fe6-d2e6-47f2-825e-9fe410a67ab6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.476497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1a9d1fe6-d2e6-47f2-825e-9fe410a67ab6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:51.477714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1a9d1fe6-d2e6-47f2-825e-9fe410a67ab6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:51.517703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.544389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 253/507] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:51.545222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d1fe6-d2e6-47f2-825e-9fe410a67ab6 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.553737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 255/508] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:51.558975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.657016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d1fe6-d2e6-47f2-825e-9fe410a67ab6 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.662913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.671535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3486b977-5ab2-4735-93be-e84fa50eccd8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.694534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.695209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.695491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.695768 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.706840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.708302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.714703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.715539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.715827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.716106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:51.723668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:51.724647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:51.725481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:51.725481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:51.725481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:51.725481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 254/509] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:51.725690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.726986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.728437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:51.744377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:51.745294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:37:51.746176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:51.753740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 256/510] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:51.753740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.763525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:51.839339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d21fd3-5408-4bfd-aa76-15eb604af01d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.862631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629490d-bfe5-4aa7-8d11-207bcc36e85a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:51.878069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.878681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.878999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.879273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.880018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:51.880325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.881913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.899813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:51.900456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:51.900739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:51.901096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:51.913133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:51.914528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:51.924900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 255/511] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:51.925766 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:51.929518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:51.930576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:51.931671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:51.931671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:51.931671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:51.931671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 257/512] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:51.931671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:51.944604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.032108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.046415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1738c78-896c-40b4-81c0-1466cb37d23c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.048626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c6aae-3340-46de-8bcc-3a30f7b095b0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.082391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.083031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.083313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.083588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.084327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:52.084628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.084979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.085603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.085888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.086082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.086172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.086840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:52.087150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.088611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.100876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 256/513] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:52.101985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.104100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 258/514] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 06:37:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:52.105150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.172473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.204097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0641b-1281-4fa9-9779-003401ead3d2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.207558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3725e095-59b4-44d1-8e35-e19679a1cee6 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.236578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.237202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.237481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.237763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.240997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.241595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.241875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.242150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.248520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.250460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.252977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:52.264690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:52.266438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:52.267315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:52.267315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:52.267315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:52.267315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 257/515] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:52.267315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.311079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.313043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.365211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6be9b8-d522-4818-952b-71d78ca83e04 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.374535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.399756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.400448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.400762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.401095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.401773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:52.402078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.403595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.410454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 259/516] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:52.411744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.429020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 258/517] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:52.430261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.497175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.532990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3a6791-80dd-4590-9523-55b6f8d863da None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.542118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809d257d-f5b1-47d3-82cb-50c83cf64a11 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.569084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.569727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.570022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.570294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.577334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.577450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.578021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.578309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.578586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.578807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:52.590153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:52.591232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 260/518] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:52.592331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.620357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.649566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.651069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.699103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498d7b8-a9ce-45e1-af2c-bb180d54ad22 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.706493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.736476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.737087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.737364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.737636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.738279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:52.738579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.739999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.751822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 261/519] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:52.752616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.753076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 259/520] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:52.753970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.841092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:52.854221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5a24d-d1d8-4baf-a701-bf8c84555656 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.856461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c11e340-0f54-4e06-ab5c-ca8c439c47a2 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:52.888129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.889226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.890038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.890315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.893519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:52.894148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:52.894431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:52.894709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:52.896959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.898405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.905245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:52.906720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:37:52.909746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:52.910663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 260/521] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:52.911694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:52.922018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:52.922991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:52.923833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:52.923833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:52.923833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:52.923833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 262/522] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:52.924058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:52.933327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.018629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5945991e-3e66-4671-b40a-d9f06c5f70bc None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.031700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3955480c-c4f9-4f60-a703-dc1683f0ac23 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.051872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.052487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.052765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.053062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.053770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:53.054075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.055546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.066307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.066975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.067262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.067541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.074471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 261/523] 10.222.0.59 () {56 vars in 1139 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:53.075475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.076252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.081767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.083291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:53.098057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:53.099116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:53.099941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:53.099941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:53.099941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:53.099941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 263/524] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:53.100166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.175821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.203638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea5a1e-79da-4dea-9eea-f543abae5b3a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.216054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4bf5a9-a3a2-4ec9-906d-0b94b112ab60 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.242340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.242974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.243260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.243525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.244170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.245606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.252445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969348-f693-4f74-8478-37b9479860fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.253056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969348-f693-4f74-8478-37b9479860fb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.253342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969348-f693-4f74-8478-37b9479860fb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.253618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df969348-f693-4f74-8478-37b9479860fb None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.254318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df969348-f693-4f74-8478-37b9479860fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:53.254624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df969348-f693-4f74-8478-37b9479860fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.256094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df969348-f693-4f74-8478-37b9479860fb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.275555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 264/525] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:53.275555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969348-f693-4f74-8478-37b9479860fb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.326635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.346634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 262/526] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:37:53 2022] POST /identity/v3/users => generated 247 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:37:53.347706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.385748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df969348-f693-4f74-8478-37b9479860fb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.428988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.429613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.429955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.430238 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.430859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:53.431173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.433153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.447397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 265/527] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:53.448276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.472678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f62d368-76ac-4e92-b9c1-44b723366631 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.508520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.515765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.516515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.516901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.517348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.570227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1901248-9aa5-4186-9f98-d9601b2c2caa None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.588103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.601239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.602721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.615813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.616428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.625184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.625184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.625184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:53.625184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.625184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.635786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 266/528] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:53.635786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.749055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 263/529] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:53.749055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.769299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874e7e8-67fb-42f5-b78e-2fbc620a051a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.777686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.810272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.811662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.812287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.813275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.814547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=2a68d368b5d14b75aaba3bbb3f4bb62c) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:53.814989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.816820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.833996 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 267/530] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/role_assignments?user.id=2a68d368b5d14b75aaba3bbb3f4bb62c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:53.833996 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.858796 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142ec193-4a19-4473-aa61-68fa81b9ea79 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:53.889570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:53.900250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:53.900906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:53.901189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:53.901465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:53.909752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:53.911318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:37:53.931624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:53.932550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:53.933378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:53.934907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 264/531] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:53.936011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:53.983689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9064df-8b39-41da-bdc9-30f478e9f2ef None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.033021 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.033699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.034030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.034930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.048851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.051101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.060332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:37:54.068685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:54.076011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:54.077602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:54.078109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42efe783-1fad-4145-9c0b-01338acef2d5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.078212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 268/532] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:54.079881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:54.115335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.116024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.116412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.116832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.129079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.130688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:54.147775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:54.148916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:54.149937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:54.149937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:54.149937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:54.151505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 265/533] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:54.152540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:54.206329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:54.215130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87be4ff-7088-45ce-9605-1c899454ce5a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.263600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.265223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.265704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.266380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.267308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:54.267813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.268479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f42f4-a9f7-4d3f-beb6-e9c725b955c8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.269627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.291915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 269/534] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:54.291915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:54.322837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.323587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.323921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.324199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.324941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:54.325249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.326819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.350723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 266/535] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:54.352731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:54.357689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:54.425153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f822e9-5fc1-4282-82c5-c758280c1c7c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.469643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.470740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.471233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.471698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.472632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:54.473125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.474855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.496808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 270/536] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:54.498250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:54.503444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f080d8-0be1-4c55-b859-aaf2b56fcf76 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.516577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:54.551897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.552754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.553043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.553322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.554609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=a4aaee9d82b74c45a3a7352595614850) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:54.554963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.557801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.565402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 267/537] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:54 2022] GET /identity/v3/role_assignments?user.id=a4aaee9d82b74c45a3a7352595614850&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:54.566952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:54.619398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5f64d5-f055-4da4-8b98-895f6832482f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.663540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:54.709944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada4229a-cceb-4188-99a0-757c4b8d57c9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:54.713564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.714265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.714551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.714846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.715599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=cc7c77697ae44017bfb40f9c77ffea1c) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:54.715908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.717666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.731678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 271/538] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:54 2022] GET /identity/v3/role_assignments?user.id=cc7c77697ae44017bfb40f9c77ffea1c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:54.763137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:54.763796 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:54.764662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:54.764954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:54.772999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:54.774523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:37:54.788383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:54.789293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:54.790115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 268/539] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:54.797275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:54.932500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:54.969944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fda92c-5b4d-4ea2-807e-21a77ae8a6a8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:55.010653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a386b72-d170-43e6-888f-7356778429a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:55.011306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386b72-d170-43e6-888f-7356778429a7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:55.011589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386b72-d170-43e6-888f-7356778429a7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:55.011867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a386b72-d170-43e6-888f-7356778429a7 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:55.012572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386b72-d170-43e6-888f-7356778429a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:55.012883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386b72-d170-43e6-888f-7356778429a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:55.014884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a386b72-d170-43e6-888f-7356778429a7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:55.028891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 272/540] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:37:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:55.035551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:55.163671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8abacd-d363-4d7a-8c5a-acd273d906c5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:55.190123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:55.203146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87318f-d487-4b4a-ae67-5a209fbab56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:55.203791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87318f-d487-4b4a-ae67-5a209fbab56a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:55.204069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87318f-d487-4b4a-ae67-5a209fbab56a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:55.204340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87318f-d487-4b4a-ae67-5a209fbab56a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:55.205084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87318f-d487-4b4a-ae67-5a209fbab56a None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=60b49283ccd0414389601e5e6f339c45) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:55.205394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87318f-d487-4b4a-ae67-5a209fbab56a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:55.206866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87318f-d487-4b4a-ae67-5a209fbab56a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:55.213583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 269/541] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:55 2022] GET /identity/v3/role_assignments?user.id=60b49283ccd0414389601e5e6f339c45&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:55.536202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca849f-38f1-4522-b863-e76d43e35b78 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:55.537258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca849f-38f1-4522-b863-e76d43e35b78 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:55.537615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ca849f-38f1-4522-b863-e76d43e35b78 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:55.539389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 273/542] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:55.545358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd18f46-d873-45bd-a976-6245abd0f688 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:55.545648 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd18f46-d873-45bd-a976-6245abd0f688 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:55.545961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd18f46-d873-45bd-a976-6245abd0f688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:55.568995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-cdd18f46-d873-45bd-a976-6245abd0f688 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:55.570233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cdd18f46-d873-45bd-a976-6245abd0f688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:55.682365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 270/543] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:55.997449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca849f-38f1-4522-b863-e76d43e35b78 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:56.130491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ca849f-38f1-4522-b863-e76d43e35b78 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:56.173299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236e37fd-ab8a-4337-b404-a67ac2d8f2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:56.173930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e37fd-ab8a-4337-b404-a67ac2d8f2b9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:56.174208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e37fd-ab8a-4337-b404-a67ac2d8f2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:56.174478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236e37fd-ab8a-4337-b404-a67ac2d8f2b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:56.184176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:56.191643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236e37fd-ab8a-4337-b404-a67ac2d8f2b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-236e37fd-ab8a-4337-b404-a67ac2d8f2b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:56.196386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:56.200382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:56.201154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 274/544] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:56.203395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd18f46-d873-45bd-a976-6245abd0f688 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:56.367403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd18f46-d873-45bd-a976-6245abd0f688 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:56.390530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16085a9-4d3a-4bc9-b594-0fb62b3956ac None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:56.390871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16085a9-4d3a-4bc9-b594-0fb62b3956ac None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:56.391112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16085a9-4d3a-4bc9-b594-0fb62b3956ac None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:56.392595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 275/545] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:56.399018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488555c-d557-4375-988e-76fc8ffac2f8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:56.399244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488555c-d557-4375-988e-76fc8ffac2f8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:56.399505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2488555c-d557-4375-988e-76fc8ffac2f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:56.403673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:56.422669 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:56.423902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:56.430649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:56.430649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:56.430649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:56.430649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:56.430649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:56.431703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2488555c-d557-4375-988e-76fc8ffac2f8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:56.432939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2488555c-d557-4375-988e-76fc8ffac2f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:56.452724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 271/546] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:56.473864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:56.572175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 276/547] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:56.627498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a00d15-a834-452c-a993-037e07eb2474 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:56.661633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:56.662273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:56.662550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:56.662844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:56.677128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:56.678638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:56.693497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:56.694995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:56.695835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:56.695835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:56.695835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:56.695835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 272/548] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:56.703040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488555c-d557-4375-988e-76fc8ffac2f8 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:56.899332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2488555c-d557-4375-988e-76fc8ffac2f8 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:56.905155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:56.943150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:56.951103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:56.960848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7add14-d795-463f-8e77-2745b09358f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:56.961469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7add14-d795-463f-8e77-2745b09358f3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:56.961746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7add14-d795-463f-8e77-2745b09358f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:56.962016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7add14-d795-463f-8e77-2745b09358f3 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:56.962687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7add14-d795-463f-8e77-2745b09358f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:56.963109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7add14-d795-463f-8e77-2745b09358f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:56.964428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7add14-d795-463f-8e77-2745b09358f3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:56.979529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 277/549] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:56.986112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1bcd-c78b-4e6c-8477-f1b61ea188b1 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:56.986656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1bcd-c78b-4e6c-8477-f1b61ea188b1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:56.994237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd1bcd-c78b-4e6c-8477-f1b61ea188b1 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:56.994237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 278/550] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:56.994237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1bcd-c78b-4e6c-8477-f1b61ea188b1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:57.032452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89477f70-0ef1-4daf-99d9-c3fbe0911b0f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.067932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7d83d-8657-4520-847e-c4105a8f0c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.068531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d83d-8657-4520-847e-c4105a8f0c7a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.068811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d83d-8657-4520-847e-c4105a8f0c7a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.069081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7d83d-8657-4520-847e-c4105a8f0c7a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.079721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7d83d-8657-4520-847e-c4105a8f0c7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-f3c7d83d-8657-4520-847e-c4105a8f0c7a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:57.084548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:57.085445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:57.086241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:57.090611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 273/551] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:57.092086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c770ef-7521-4a5a-9b15-1592af523714 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.092376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c770ef-7521-4a5a-9b15-1592af523714 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.092654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c770ef-7521-4a5a-9b15-1592af523714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.109304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd1bcd-c78b-4e6c-8477-f1b61ea188b1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.111313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b5c770ef-7521-4a5a-9b15-1592af523714 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:57.113043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b5c770ef-7521-4a5a-9b15-1592af523714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:57.147409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.148605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.149218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.149886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] PATH_INFO: `/v3/users/swift` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.158750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:57.160681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:57.175449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:57.176478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:37:57.177402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:57.179802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 279/552] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:37:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:57.185614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:57.190014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 274/553] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:57.200388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c770ef-7521-4a5a-9b15-1592af523714 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:57.244054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:57.254306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:57.302908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab00d0b-87b2-40d2-94dc-dd333df192eb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.339093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9673cc6-97e4-4f04-9904-ed23246888a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.339806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673cc6-97e4-4f04-9904-ed23246888a0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.340161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673cc6-97e4-4f04-9904-ed23246888a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.340548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9673cc6-97e4-4f04-9904-ed23246888a0 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.341299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673cc6-97e4-4f04-9904-ed23246888a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:57.341687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673cc6-97e4-4f04-9904-ed23246888a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:57.343694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9673cc6-97e4-4f04-9904-ed23246888a0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:57.352171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c770ef-7521-4a5a-9b15-1592af523714 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.352448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 280/554] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:57.353657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ba08-4c6c-463c-9009-ceee3e15ee13 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.353943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ba08-4c6c-463c-9009-ceee3e15ee13 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.354229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ba08-4c6c-463c-9009-ceee3e15ee13 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.360053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 281/555] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:57.360053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ba08-4c6c-463c-9009-ceee3e15ee13 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:57.395410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bc54d5-4040-4bca-beb2-004652f6eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.396375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc54d5-4040-4bca-beb2-004652f6eab4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.396885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc54d5-4040-4bca-beb2-004652f6eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.397362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bc54d5-4040-4bca-beb2-004652f6eab4 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.398309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc54d5-4040-4bca-beb2-004652f6eab4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:57.398943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc54d5-4040-4bca-beb2-004652f6eab4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:57.400908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bc54d5-4040-4bca-beb2-004652f6eab4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:57.422193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 275/556] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 06:37:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:57.423791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095362-122b-46b2-a71a-d004306e735d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.424290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095362-122b-46b2-a71a-d004306e735d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.424840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85095362-122b-46b2-a71a-d004306e735d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.445421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-85095362-122b-46b2-a71a-d004306e735d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:57.447019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-85095362-122b-46b2-a71a-d004306e735d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:57.475747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ba08-4c6c-463c-9009-ceee3e15ee13 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.503797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:57.518307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1a59e0-c36c-4649-8292-973ac102e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.518971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a59e0-c36c-4649-8292-973ac102e048 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.519248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a59e0-c36c-4649-8292-973ac102e048 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.519516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1a59e0-c36c-4649-8292-973ac102e048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.536551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 276/557] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:57.537466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85095362-122b-46b2-a71a-d004306e735d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:57.538294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a59e0-c36c-4649-8292-973ac102e048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:57.540358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1a59e0-c36c-4649-8292-973ac102e048 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:57.553785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-cc1a59e0-c36c-4649-8292-973ac102e048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:57.559356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:57.565800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 282/558] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eea06-192e-4ee5-879f-2219b9415ffa None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eea06-192e-4ee5-879f-2219b9415ffa None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2eea06-192e-4ee5-879f-2219b9415ffa None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 283/559] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:37:57.566660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eea06-192e-4ee5-879f-2219b9415ffa None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:57.657544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85095362-122b-46b2-a71a-d004306e735d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.683384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2eea06-192e-4ee5-879f-2219b9415ffa None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.705932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.706927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.707219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.707500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.737084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.737842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.738146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.738462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.749632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:57.756222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:57.757653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:57.758487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 284/560] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:57.759682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:57.790582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:57.793471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:57.795015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:57.809928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:57.873122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e5b0f-4cd1-40e5-b3f1-dee76aeb8960 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:57.911901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a1bcce-ee63-473d-aa3b-08c37d28c978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:57.912429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1bcce-ee63-473d-aa3b-08c37d28c978 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.912719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1bcce-ee63-473d-aa3b-08c37d28c978 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.912991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a1bcce-ee63-473d-aa3b-08c37d28c978 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.913646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1bcce-ee63-473d-aa3b-08c37d28c978 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:57.913951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1bcce-ee63-473d-aa3b-08c37d28c978 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:57.915385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a1bcce-ee63-473d-aa3b-08c37d28c978 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:57.929226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 285/561] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:57.930487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a49e2-2742-4ac0-82af-73bec054b56e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:57.930785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a49e2-2742-4ac0-82af-73bec054b56e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:57.931104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0a49e2-2742-4ac0-82af-73bec054b56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:57.949805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0b0a49e2-2742-4ac0-82af-73bec054b56e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:37:57.950399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 277/562] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:37:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:37:57.951063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0b0a49e2-2742-4ac0-82af-73bec054b56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:37:57.951913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.025753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 286/563] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:37:58.026663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a49e2-2742-4ac0-82af-73bec054b56e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.041639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.064657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909afb2-0801-49cb-a01c-2fbebf3d7ae4 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.078556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.099590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.100202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.100507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.100843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.101775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:58.102318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.104115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.112750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 278/564] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:58.113732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.137406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0a49e2-2742-4ac0-82af-73bec054b56e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.177200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.178601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.179062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.179638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.192830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:58.199322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:58.200440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:58.202014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:58.204042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 287/565] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:58.209476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.221692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96d717-4f35-4fff-afe0-55cba1311fef None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.255860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.256489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.256768 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.257042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.265197 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.266642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:58.277803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:58.278753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 279/566] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:58.279826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.289716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.314443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.320843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036fae8e-3d8e-4a18-a372-78fc452dceac None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.357601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.358355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.358636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.358942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.369204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.370659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.383194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d107b7-f009-473f-bc46-62d5dc239561 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:58.386025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:58.387213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:58.388097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:58.388097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:58.388097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:58.388097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 288/567] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:58.388097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.419316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.419956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.420749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.421256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.431882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.433331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:58.449459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:58.450589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:58.451580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:58.451580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:58.451580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:58.451580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 280/568] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:58.451580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.493361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b6a764-f7fd-4ed1-9c0b-3b49e82fc048 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.519144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.530207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.535851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.535851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.535851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.535851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:58.535851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.535851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.541007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.541557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 289/569] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:58.542640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.559486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4858c4-0277-4137-b547-9eb92540592f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.595805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.596427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.596713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.596989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.597745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:58.598078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.599570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.617199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 281/570] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:58.618062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.649091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe91ffbb-0e79-4257-8466-19186c8eee2d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.686418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.687223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.687223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.687513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.697864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:37:58.703681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:58.704618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:58.705445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 290/571] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:58.706177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.726844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37d210-e6a1-4115-a9db-4620cc3727c0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.753488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.762051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.762670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.762985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.765352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.765352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:58.765352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.766211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.783771 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 282/572] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:58.783771 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.784529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:58.812484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c85f38-ddb5-4166-ab9c-2584a07c8e2c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.848363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.849017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.849358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.849577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.850218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:58.850525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.851942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.864620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 291/573] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:58.865439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.891742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886709a8-36ee-4c56-992d-7bd05192ff62 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.925660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:58.926287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:58.926570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:58.926879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:58.937902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:58.939325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:58.953567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:58.954519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:58.955945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:58.955945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:58.955945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:58.955945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 283/574] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:58.955945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:58.974936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40203ee-9555-41a5-81b4-04d1643ffee0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:58.982198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.009135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.009773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.010062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.010182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.010342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.020799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.022252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:59.037403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:59.038408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:59.043930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:59.043930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:59.043930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:59.043930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 292/575] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:59.043930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.059195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37170085-391b-49e3-bd7c-a00e667578fa None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.096265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.096869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.097146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.097421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.098082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:59.098382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.099798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.108263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 284/576] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:37:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:59.109173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.151330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265cc11-6d1f-4342-9eee-e38cf93ab533 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.186672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.187324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.187602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.187875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.195317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.196683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:37:59.209725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:59.210744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 293/577] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:59.211673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.220997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a66eeb-a288-4ec4-b150-0be615ea26ca None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.234329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.239370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.256527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.257176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.257463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.257739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.266094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.267645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:59.278594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:59.280198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:59.281142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 285/578] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:59.281724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.317822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad876c-ad86-46c6-8ad4-06f1dd5c953b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.351941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.352548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.352834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.353116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.353755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:59.354062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.355471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.367046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 294/579] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:59.367850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.388253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b016ad1-6d81-4d3c-ac29-119ade409c18 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.422783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.423393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.423676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.423953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.424599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:59.424908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.426263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.437884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 286/580] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:59.437884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.445954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.468307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32542796-e332-4540-a7ac-b7f3003d38e8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.479949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.504546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.505176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.505473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.505731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.516252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.518107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:37:59.533227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:59.534237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:37:59.535210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:37:59.535210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:37:59.535210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:59.535210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 295/581] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:59.539347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.539522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfb09d6-49aa-43f0-85d4-4a1847e91ade None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.576573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.577184 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.577466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.577738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.578441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:59.578745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.580222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.592379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 287/582] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:59.593217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.646686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac348c6d-5ef6-4c5e-9fca-163014a84f21 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.679858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.686126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.686740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.687359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.687359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.688036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:59.688341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.689783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.693893 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.706867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253a54f-9ad8-48b2-8335-6ffdbc3d12a0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.710741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 296/583] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:59.711614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.736720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.737347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.737624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.737895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.744896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.746323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:37:59.758061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:59.759112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:37:59.760103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 288/584] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:59.760689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.814610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069585c4-51ab-4d66-86fe-264737d978de None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.848051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.848683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.848960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.849254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.856032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.857622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:37:59.869616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:37:59.870586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 297/585] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:37:59.877012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.877573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03869d9-11ff-43c4-bed5-21ee32e1f766 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:37:59.917942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:37:59.918581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:37:59.918893 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:37:59.919172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:37:59.919826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:37:59.920642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:37:59.922036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:37:59.930036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.935176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 289/586] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:37:59.936188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:37:59.955306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:37:59.987540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c4de6f-0d51-493b-bcae-e5939ee9b1ba None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.021206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.021801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.022085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.022356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.023117 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=c1dfd6a8d9194f7a949a77207931eb15) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:00.023473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.024848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.030128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 298/587] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/role_assignments?user.id=c1dfd6a8d9194f7a949a77207931eb15&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:00.030930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.052618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cfacc6-e165-4615-9488-f34097166b6e None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.092931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.093960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.094556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.094888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.106788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.108967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:00.125966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:00.127224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:00.128129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:00.128129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:00.128129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:00.128129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 290/588] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:37:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:00.128129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.150675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7670b26e-e50a-48e4-9e56-4ca1f35fcf29 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.171215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:00.195234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.195938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.196221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.196493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.197223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:00.197579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.199147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.214454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:00.218237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 299/589] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:00.218912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.253976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfd35e8-f63c-4590-bc0a-f9e88541ab36 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.293391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.294536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.295724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.296155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.296855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:00.297170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.298858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.318166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 291/590] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:00.318166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.337940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5e136-cd4d-4fca-bec7-2a894c496fc9 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.375435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.376099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.376349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.376750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.384520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.385970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:00.399041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:00.400019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 300/591] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:00.400930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.436338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:00.444844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77815a-f778-4afd-8807-db8efc00d1cf None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.489813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:00.497735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.498736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.499130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.499583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.500451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:00.500970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.502632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.527167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 292/592] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:00.528359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.535952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acf7d05-7836-47be-9b3d-653e1f30aa54 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.589821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.590871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.591476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.592475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.604397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.605931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:00.621852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:00.622889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:00.624273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:00.624273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:00.624273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:00.624273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 301/593] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:00.624273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.659096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8167363b-a4b7-4398-8dcd-4c142cae29ce None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.705166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.706142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.706587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.707766 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/2a68d368b5d14b75aaba3bbb3f4bb62c/roles/88decb556961404a9be5356f86b742f1` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.729534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:00.732342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=2a68d368b5d14b75aaba3bbb3f4bb62c, role_id=88decb556961404a9be5356f86b742f1)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.733807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.749090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ea00ba-b67f-4c86-8dc7-f1b25256e5f5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.785480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.786106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.786389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.786669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:00.787467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:00.787792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:00.789204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:00.807282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 302/594] 10.222.0.59 () {56 vars in 1139 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:00.808137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.819563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 293/595] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:00 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/2a68d368b5d14b75aaba3bbb3f4bb62c/roles/88decb556961404a9be5356f86b742f1 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:38:00.820218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:00.911237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:00.948998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88139c7b-5e21-4403-aef8-f883023745d2 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:00.993381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:00.994626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:00.995988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:00.996482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.011288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.012745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.015307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5491fde3-0473-4dd1-aa6d-0c0d1cf8ce37 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.017844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:01.028380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:01.034389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 303/596] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:01.036056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.068701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.069886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.070419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.070905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.071663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:01.072083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.074377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.090461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 294/597] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:01.091656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.178380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50f1b7-9948-4652-b3cf-bb48bc82ede8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.211858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:01.215074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1865cd31-b0bd-4737-a92d-6e481dc042d3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.217641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.218798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.218798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.219043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.230184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.231741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:01.248969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:01.250262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:01.251298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:01.251298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:01.251298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:01.251298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 304/598] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:01.251298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.255477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.256371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.256872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.257352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.258313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:01.258848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.260494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.273366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 295/599] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:01.274523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.310619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:01.366485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498200a5-6a90-41eb-979d-3ae9d7600a9f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.394940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d5de8-52c2-487f-80a3-2b24ca1e1bd5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.403782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.405186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.405301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.405580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.413812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.415447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:01.429622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:01.430588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 305/600] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:01.431875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.444199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.446100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.447169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.447453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.448134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:01.448444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.449849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.469635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 296/601] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:01.470522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.495114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:01.563166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3c2ad3-aa9b-4a1a-894a-f7f4673046f4 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.578320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:01.601606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.602348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.602636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.602960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/a4aaee9d82b74c45a3a7352595614850/roles/88decb556961404a9be5356f86b742f1` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.622486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=a4aaee9d82b74c45a3a7352595614850, role_id=88decb556961404a9be5356f86b742f1)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.624488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.629551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254b4ed-6a80-4b2e-990e-479ebdf00f89 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.664873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.665733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.666170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.666624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.667804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:01.668266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.670412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.683928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 297/602] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:01.684971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.693561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 306/603] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:01 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/a4aaee9d82b74c45a3a7352595614850/roles/88decb556961404a9be5356f86b742f1 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:38:01.699485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:01.870137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:01.900546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30d1fff-22cd-4265-ad18-281b7a1a3b22 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.901844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47a810b-f06a-4b26-9a07-6cd6cff1f740 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:01.945889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225f1ae5-4518-4ef5-84a7-0fc3b7fbe3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.946564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f1ae5-4518-4ef5-84a7-0fc3b7fbe3e3 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.946879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f1ae5-4518-4ef5-84a7-0fc3b7fbe3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.947161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225f1ae5-4518-4ef5-84a7-0fc3b7fbe3e3 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/cc7c77697ae44017bfb40f9c77ffea1c/roles/88decb556961404a9be5356f86b742f1` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.951021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:01.955005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:01.955318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:01.955605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:01.965029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f1ae5-4518-4ef5-84a7-0fc3b7fbe3e3 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=cc7c77697ae44017bfb40f9c77ffea1c, role_id=88decb556961404a9be5356f86b742f1)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.965645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:01.966503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225f1ae5-4518-4ef5-84a7-0fc3b7fbe3e3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.967677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:01.984398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:01.999307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 298/604] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:02.000196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:02.047104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 307/605] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:01 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/cc7c77697ae44017bfb40f9c77ffea1c/roles/88decb556961404a9be5356f86b742f1 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:38:02.048457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6e92b-d8da-4055-a428-01828a896474 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.048738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6e92b-d8da-4055-a428-01828a896474 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.049015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6e92b-d8da-4055-a428-01828a896474 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.051649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 308/606] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:02.074126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad199e-eeac-4aeb-9ed2-5940e952bfda None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.074579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad199e-eeac-4aeb-9ed2-5940e952bfda None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.074847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad199e-eeac-4aeb-9ed2-5940e952bfda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.098678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-18ad199e-eeac-4aeb-9ed2-5940e952bfda None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:02.099975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-18ad199e-eeac-4aeb-9ed2-5940e952bfda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:02.121221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:02.214579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1d369-89dc-4bad-9927-c3f309225a1a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:02.243389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 309/607] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:38:02.264278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:02.264900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.265229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.265504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.266252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:02.266562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:02.268048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:02.281079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 299/608] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:02.283151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:02.287120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad199e-eeac-4aeb-9ed2-5940e952bfda None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:02.396624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad199e-eeac-4aeb-9ed2-5940e952bfda None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:02.432497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:02.433519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.434023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.434586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/60b49283ccd0414389601e5e6f339c45/roles/88decb556961404a9be5356f86b742f1` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.447624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:02.454844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=60b49283ccd0414389601e5e6f339c45, role_id=88decb556961404a9be5356f86b742f1)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:02.456332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:02.524574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:02.536031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 310/609] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:02 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/60b49283ccd0414389601e5e6f339c45/roles/88decb556961404a9be5356f86b742f1 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:38:02.671675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9eee4e-ff9f-4fd6-8941-423c586d9342 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:02.728898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67535c-5ce1-4d7b-bd9f-e5f57b47f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:02.729556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67535c-5ce1-4d7b-bd9f-e5f57b47f63b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.729845 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67535c-5ce1-4d7b-bd9f-e5f57b47f63b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.730127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67535c-5ce1-4d7b-bd9f-e5f57b47f63b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.751489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e67535c-5ce1-4d7b-bd9f-e5f57b47f63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-6e67535c-5ce1-4d7b-bd9f-e5f57b47f63b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:02.756882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:02.758884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:02.759854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 300/610] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:02.767291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:02.915210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69904304-cce1-4efc-9b4f-8f35d70ccd43 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:02.951740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:02.952287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.952574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.952859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.953540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:02.953849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:02.955622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:02.956559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b4fb-2329-4cd3-ab9f-b517c390043a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.957060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b4fb-2329-4cd3-ab9f-b517c390043a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.957212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4b4fb-2329-4cd3-ab9f-b517c390043a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.958725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 301/611] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:02.964252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ab85-afce-4004-b392-deb756c15b39 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:02.964537 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ab85-afce-4004-b392-deb756c15b39 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:02.964818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86ab85-afce-4004-b392-deb756c15b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:02.965032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 311/612] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:02.971460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:02.985709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-2e86ab85-afce-4004-b392-deb756c15b39 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:02.987094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2e86ab85-afce-4004-b392-deb756c15b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:03.029997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:03.084655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba818562-884a-4f34-a436-924c42aa7ebb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:03.123651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:03.124406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:03.124759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:03.125138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:03.136787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:03.138395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:03.154018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:03.155057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:03.156132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:03.156132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:03.156132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:03.156132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 312/613] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:03.158223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:03.163679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:03.182114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 302/614] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:38:03.274173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af3b791-9245-43a7-9eec-0bcb63c70356 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:03.281972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:03.311027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:03.311651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:03.312019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:03.312223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:03.312861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:03.313561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:03.315000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:03.328129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 313/615] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:03.333706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86ab85-afce-4004-b392-deb756c15b39 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:03.445357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86ab85-afce-4004-b392-deb756c15b39 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:03.491623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:03.492266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:03.492544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:03.492817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:03.505848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:03.507324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:03.522026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:03.523044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:03.524578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 303/616] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:03 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:03.531689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:03.642790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1967a-ef1f-4396-be35-42f7234bb343 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:03.676736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:03.679082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:03.679704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:03.679986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:03.680261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:03.681004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:03.681310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:03.682755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:03.702475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 314/617] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 06:38:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:03.707966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:03.750711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:03.812078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4825154-a10a-43ca-8367-bcca5e436266 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:03.823574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd48439-eb3f-4c9b-968c-bc9cffb67408 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:03.827159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:03.865950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:03.866783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:03.867210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:03.867582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:03.871177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:03.871898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:03.872185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:03.872495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:03.880335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:03.882034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:03.902107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:03.902891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:03.904042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:03.905258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:03.905258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:03.905258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:03.905258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 315/618] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:03.909932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:03.912316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:03.914572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:03.916421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:03.917744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 304/619] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:03.922793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.090996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda165e-096c-4dff-8f51-8cb411b44ce6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:04.093379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:04.112570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:04.135531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a09ee15-79c7-4ce8-9d27-0358b56f287a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:04.155265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:04.155889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.156174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.156456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.157135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:04.157445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:04.158852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:04.183686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 305/620] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:04.189735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.204412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299457fe-9d2d-42a1-b9f4-6ce3291cc90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:04.205534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299457fe-9d2d-42a1-b9f4-6ce3291cc90f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.206041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299457fe-9d2d-42a1-b9f4-6ce3291cc90f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.206535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299457fe-9d2d-42a1-b9f4-6ce3291cc90f None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.207454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299457fe-9d2d-42a1-b9f4-6ce3291cc90f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:04.208019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299457fe-9d2d-42a1-b9f4-6ce3291cc90f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:04.209713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299457fe-9d2d-42a1-b9f4-6ce3291cc90f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:04.225351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 316/621] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:04.227695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3dc30-358b-4f51-8107-deda831cf806 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.229232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3dc30-358b-4f51-8107-deda831cf806 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.229702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3dc30-358b-4f51-8107-deda831cf806 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.231265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 317/622] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:04.236210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3dc30-358b-4f51-8107-deda831cf806 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.330580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30daa476-f8a2-4934-892f-1df62d57a1f5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:04.350064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3dc30-358b-4f51-8107-deda831cf806 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:04.380779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece98a04-8abc-4d77-ba0f-46691fd2700e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:04.381507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98a04-8abc-4d77-ba0f-46691fd2700e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.381798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98a04-8abc-4d77-ba0f-46691fd2700e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.382081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece98a04-8abc-4d77-ba0f-46691fd2700e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.397995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece98a04-8abc-4d77-ba0f-46691fd2700e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:04.399549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece98a04-8abc-4d77-ba0f-46691fd2700e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:04.401480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:04.402945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.403761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.404541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.410665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:04.418563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-ece98a04-8abc-4d77-ba0f-46691fd2700e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:04.421355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:04.422430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:04.423483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:04.423483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:04.423483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:04.424513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:04.425573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 306/623] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:04.427240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43417-6fd0-4059-ab01-1150732693da None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.427707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43417-6fd0-4059-ab01-1150732693da None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.428144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a43417-6fd0-4059-ab01-1150732693da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:04.448787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:04.449899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:04.451010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:04.452912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c2a43417-6fd0-4059-ab01-1150732693da None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:04.454487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c2a43417-6fd0-4059-ab01-1150732693da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:04.456026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 318/624] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:04.457108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.481291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:04.545209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 307/625] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:04.546210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43417-6fd0-4059-ab01-1150732693da None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.590252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beabe812-d719-44fc-b710-31bec63082d9 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:04.627738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ad7aa-9354-4462-ab02-a72ffc204313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:04.628917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad7aa-9354-4462-ab02-a72ffc204313 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.629792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad7aa-9354-4462-ab02-a72ffc204313 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.630562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ad7aa-9354-4462-ab02-a72ffc204313 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.631496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad7aa-9354-4462-ab02-a72ffc204313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:04.632224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad7aa-9354-4462-ab02-a72ffc204313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:04.634482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ad7aa-9354-4462-ab02-a72ffc204313 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:04.650578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 319/626] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:04.652276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda825-d6b6-41f8-8b6a-43dcdf7de531 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.652854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda825-d6b6-41f8-8b6a-43dcdf7de531 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.653354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dda825-d6b6-41f8-8b6a-43dcdf7de531 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.655872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 320/627] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:04.656930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda825-d6b6-41f8-8b6a-43dcdf7de531 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.686329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a43417-6fd0-4059-ab01-1150732693da None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:04.732073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eaedfd-512d-4c92-98e8-23cb015e54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:04.732702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaedfd-512d-4c92-98e8-23cb015e54f4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.732993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaedfd-512d-4c92-98e8-23cb015e54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.733273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eaedfd-512d-4c92-98e8-23cb015e54f4 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.734241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaedfd-512d-4c92-98e8-23cb015e54f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:04.734563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaedfd-512d-4c92-98e8-23cb015e54f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:04.735956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:04.737273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eaedfd-512d-4c92-98e8-23cb015e54f4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:04.758704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 308/628] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:04.760136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974c3a-e96e-4d45-b549-8240a271dbe6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.760430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974c3a-e96e-4d45-b549-8240a271dbe6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.760713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f974c3a-e96e-4d45-b549-8240a271dbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.786046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-6f974c3a-e96e-4d45-b549-8240a271dbe6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:04.787287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6f974c3a-e96e-4d45-b549-8240a271dbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:04.788589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dda825-d6b6-41f8-8b6a-43dcdf7de531 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:04.798222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:04.840006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:04.840929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:04.841411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:04.841690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:04.849413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:04.850911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:04.862711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:04.863788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 321/629] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:38:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:04.864822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.883396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 309/630] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:04.883396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f974c3a-e96e-4d45-b549-8240a271dbe6 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:04.990968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f974c3a-e96e-4d45-b549-8240a271dbe6 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.010144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce52ff-e94c-4f0d-b7c5-3cc61d83ea01 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.027866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.028498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.029291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.029584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.033336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.041285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:05.047037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:05.048205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:05.049166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 310/631] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:05.049871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.055241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.064005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.065642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.066134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.066653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/c1dfd6a8d9194f7a949a77207931eb15/roles/88decb556961404a9be5356f86b742f1` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.088512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=c1dfd6a8d9194f7a949a77207931eb15, role_id=88decb556961404a9be5356f86b742f1)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:05.092503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:05.170264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39033006-1ab5-4be9-a868-29fb5ad6a1a0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.176146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 322/632] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:04 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/c1dfd6a8d9194f7a949a77207931eb15/roles/88decb556961404a9be5356f86b742f1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:38:05.176992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.215497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d0b67e-eec9-455c-a68f-ec1d6830387c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.216130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b67e-eec9-455c-a68f-ec1d6830387c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.216457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b67e-eec9-455c-a68f-ec1d6830387c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.216735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d0b67e-eec9-455c-a68f-ec1d6830387c None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.217493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0b67e-eec9-455c-a68f-ec1d6830387c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:05.217826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0b67e-eec9-455c-a68f-ec1d6830387c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:05.219334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d0b67e-eec9-455c-a68f-ec1d6830387c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:05.241962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 311/633] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:05.243428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24c544-d2db-4e1c-8ebc-a505e7a54554 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.243715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24c544-d2db-4e1c-8ebc-a505e7a54554 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.243993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab24c544-d2db-4e1c-8ebc-a505e7a54554 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.245613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 312/634] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:05.246491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24c544-d2db-4e1c-8ebc-a505e7a54554 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.308345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d48445-430e-4c9f-9d90-3f03f33ac9b1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.316863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.349309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.350025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.350377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.350952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.352643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:05.353022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:05.354522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:05.366813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 323/635] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:05.366813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.368728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab24c544-d2db-4e1c-8ebc-a505e7a54554 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.397988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.404829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8484813-52af-44b9-b890-a9c5d18b94f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.405539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484813-52af-44b9-b890-a9c5d18b94f8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.405886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484813-52af-44b9-b890-a9c5d18b94f8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.406215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8484813-52af-44b9-b890-a9c5d18b94f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.416284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8484813-52af-44b9-b890-a9c5d18b94f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-f8484813-52af-44b9-b890-a9c5d18b94f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:05.421822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:05.422871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:05.423725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:05.427701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 313/636] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:05.428734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e801dd-5620-4842-afdc-cbeecab03376 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.429026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e801dd-5620-4842-afdc-cbeecab03376 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.429298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e801dd-5620-4842-afdc-cbeecab03376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.447461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b4e801dd-5620-4842-afdc-cbeecab03376 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:05.448949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b4e801dd-5620-4842-afdc-cbeecab03376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:05.481211 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f16876f-4000-41fd-acc0-e4c0b3722da7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.523111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.523727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.524012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.524289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.529677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 314/637] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:05.530921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e801dd-5620-4842-afdc-cbeecab03376 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.594598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.611411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:05.612884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:05.645058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e801dd-5620-4842-afdc-cbeecab03376 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.647178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.684796 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.686344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.686861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.687338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.703321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:05.705122 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:05.726253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:05.727476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:05.728350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:05.728350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:05.728350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:05.730512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 315/638] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:05.731527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.737642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 324/639] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:05.738516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.850054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f2349c-dab6-4feb-82c5-346165e684d1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.852631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.870672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4eea09-e29f-4379-8a22-274a04792425 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:05.886791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.887597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.887974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.889191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.890202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:05.890835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:05.893449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:05.902209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 316/640] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:05.903297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:05.907405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:05.921890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:05.922711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:05.923276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:05.923767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:05.924962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:05.925648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:05.928236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:05.947393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 325/641] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:05.948524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.011947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782bcc17-b6bc-4667-ac53-9d7a005e8a08 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.048706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.049341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.049626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.049897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.053078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd220596-4afd-4c10-aa1a-a4077294349a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.061291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.062723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:06.077408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:06.078561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:06.079932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:06.079932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:06.079932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:06.083012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 317/642] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:06.083797 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.093429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.094280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.094712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.095029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.103924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.110883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:06.116397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:06.120987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 326/643] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:06.121837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.172621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.199929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063098c3-bc14-405a-a7a1-753daaf4bbd8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.230468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374c49c2-0bf8-48fb-978d-250f3238b867 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.236070 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.236779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.237130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.237472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.249369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.251004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:06.267458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:06.268671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:06.269959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:06.269959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:06.269959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:06.273159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.273866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.274336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.274572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.274939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 318/644] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:06.275649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.283487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.285090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:06.297606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:06.299060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 24 06:38:06.300385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:06.303498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 327/645] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:06.304163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.355895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.389503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee83c88-ee01-4fff-830d-ffc39f4a4a57 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.410616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc49cd37-24d0-4f8a-93d7-5e35bfe08de9 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.420793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.429670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.430438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.430849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.431227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.431973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:06.432386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.433840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.445966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 319/646] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:06.446131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.446608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.446918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.447189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.447849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:06.448269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.449522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.451140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.465365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 328/647] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:06.466915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.563950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bcfe55-ae0e-4328-8e08-d7774496d0fd None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.575079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb727cbe-7dfa-465d-addc-1eee82e86066 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.594667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.600805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.601172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.601455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.601732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.602385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:06.602694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.604127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.613303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.614447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.614447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.617648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.617648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:06.617648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.617648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.623469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 320/648] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:06.623469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.637426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 329/649] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:06.638311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.673398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.751773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb20707c-4139-4b34-865c-7f8d3cc17432 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.759130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf65f7a7-03d2-4b2c-8677-c75e71e06fbf None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.793632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.794289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.794579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.794883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.797189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.797919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.798293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.798664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.801915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.803415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.810489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.811469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:06.815166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:06.816212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:06.817322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:06.821327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 321/650] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:06.821872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:06.830249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:06.831657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:06.832774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:06.832774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:06.832774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:06.833387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 330/651] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:06.834160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:06.884637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.921026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:06.935665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634e706-2b0b-49ce-9025-61ffb3567508 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.942020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d297ed82-176d-4a79-8358-fdcdefdca41f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:06.975765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.976329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.976608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.976881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.979515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:06.980192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:06.980544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:06.980881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:06.986548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:06.988054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:07.004137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:07.005526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:07.007176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 322/652] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:07.009480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.067322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.069035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.123466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3d0ef-bb25-4a68-a38b-c03e0860dfcd None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.133725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:07.158053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.158666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.159002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.159283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.160079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:07.160416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.161863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.162850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:07.175566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 323/653] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:07.176456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.184142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 331/654] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:07.185049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.282459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ff319e-1a02-4779-b546-32bb9839a230 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.288533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876c5c2d-37db-4a81-8d67-6e03f5fc3a6e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.316934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f633d6a-9ccd-4023-acb0-0e926d296c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.317540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633d6a-9ccd-4023-acb0-0e926d296c1f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.317825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633d6a-9ccd-4023-acb0-0e926d296c1f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.318107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f633d6a-9ccd-4023-acb0-0e926d296c1f None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.318747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f633d6a-9ccd-4023-acb0-0e926d296c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:07.319080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f633d6a-9ccd-4023-acb0-0e926d296c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.320441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f633d6a-9ccd-4023-acb0-0e926d296c1f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.322722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.323381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.323667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.323941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.324662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:07.324966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.326413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.332617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 324/655] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:07.333973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc8f1f-2988-4299-8bca-bf31313d5398 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.334409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc8f1f-2988-4299-8bca-bf31313d5398 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.334699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc8f1f-2988-4299-8bca-bf31313d5398 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.337053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 325/656] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:07.337780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc8f1f-2988-4299-8bca-bf31313d5398 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.344384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 332/657] 10.222.0.59 () {56 vars in 1137 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:07.345271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.372110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:07.385179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:07.444240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc8f1f-2988-4299-8bca-bf31313d5398 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.445616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d84033-38d2-43c4-8dbe-f5b0d757a001 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.481470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.481978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbd877b-3889-458a-9b2a-7c0befbec59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.482129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.482401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.482613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd877b-3889-458a-9b2a-7c0befbec59a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.482708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.482924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd877b-3889-458a-9b2a-7c0befbec59a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.483199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbd877b-3889-458a-9b2a-7c0befbec59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.483410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=2a68d368b5d14b75aaba3bbb3f4bb62c) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:07.483714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.485132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.491239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 326/658] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/role_assignments?user.id=2a68d368b5d14b75aaba3bbb3f4bb62c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:07.492066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.499637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd877b-3889-458a-9b2a-7c0befbec59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.501168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbd877b-3889-458a-9b2a-7c0befbec59a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-adbd877b-3889-458a-9b2a-7c0befbec59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:07.520350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:07.521377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:07.522263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:07.522263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:07.522263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:07.522263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 333/659] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:07.523065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db21eb-6174-4def-9d8c-52a6f56c4042 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.523065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db21eb-6174-4def-9d8c-52a6f56c4042 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.523808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56db21eb-6174-4def-9d8c-52a6f56c4042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.544393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-56db21eb-6174-4def-9d8c-52a6f56c4042 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:07.546120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-56db21eb-6174-4def-9d8c-52a6f56c4042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:07.629441 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 334/660] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:07.630483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db21eb-6174-4def-9d8c-52a6f56c4042 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.642758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:07.652904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67b499-d995-445c-8396-2794f807b19d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.657236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:07.704165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.705492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.705492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.705684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.714840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.717835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:07.734141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:07.735923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 24 06:38:07.736853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:07.738851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 327/661] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:07.740058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.764548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56db21eb-6174-4def-9d8c-52a6f56c4042 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.815738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.816275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.816564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.816835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.883882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446445d4-9d4b-4ac8-942f-6eef9f7cb69b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:07.905445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.907035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.927508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:07.928119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:07.928401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:07.928677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:07.929394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:07.929631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:07.930175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:07.931090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:07.943604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 328/662] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:07.944771 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:07.962274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.022947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 335/663] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:08.023819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.060657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a448b57-98c0-4d4f-bb4e-57924eccbdbe None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.096415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.096951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.097227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.097501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.098228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:08.098532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.099998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.121806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 329/664] 10.222.0.59 () {56 vars in 1139 bytes} [Wed Aug 24 06:38:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:08.121806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.143297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d02a395-8675-4b15-80ce-e3aa2128db50 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.167802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.185017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.185910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.186465 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.186787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.204565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:08.213303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:08.223829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 336/665] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:08.225004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.226868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.254686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a901a-3cfa-4460-87d8-44e3f0ab63aa None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.294279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.295006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.295254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.295527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.302666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.304211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:08.316331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:08.322274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 330/666] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:08.323591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.353718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9468b56-f99c-4f8a-8196-e80129b14d3f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.388686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.389408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.389694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.389966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.400744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.402201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:08.416786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:08.418172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:08.419073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:08.419073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:08.419073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:08.419073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 337/667] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:08.419073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.438792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fa2114-3518-4007-bdb3-2c53f0f2f1d8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.449820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.470238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.475114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.475721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.476001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.476313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.524671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06da2a13-85fa-4e03-b887-e40596b876a1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.548151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.549788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.561979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.562740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.562880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.563147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.563853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:08.564121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.565545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.575015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 338/668] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:08.580402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.666551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 331/669] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:08.668060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.689791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.697427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36f4602-3983-4d1e-84a4-223088e78882 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.721544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.741036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.741711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.741932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.742205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.742944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:08.743247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.744700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.758799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 339/670] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:08.758799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.813520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f85e8fc-3441-4cdd-bf83-e708fb7e72b1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.852353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.853073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.853434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.853777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.854504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:08.854949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.856367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.869402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 332/671] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:08.870360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.878131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac007c-6923-4459-8396-54878079ef54 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:08.916024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:08.916720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:08.917187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:08.917461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:08.929302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:08.930947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:08.944839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:08.945822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:08.951952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:08.951952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:08.951952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:08.951952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 340/672] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:08.951952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:08.959897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.976044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:08.985044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ad7b9-678b-4ab1-8ea2-ac3b82fcf617 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.018455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.019173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.019458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.019734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.030565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.032136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:09.048098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:09.049389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:09.050274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:09.050274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:09.050274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:09.050274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 333/673] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:09.050274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.065799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a45f7-6ab4-4c57-9d6e-6f1cff012446 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.104397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.105496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.106393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.106393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.107079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=a4aaee9d82b74c45a3a7352595614850) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:09.107377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.109621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.117136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 341/674] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:08 2022] GET /identity/v3/role_assignments?user.id=a4aaee9d82b74c45a3a7352595614850&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:09.117942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.164714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f871dbf-1887-4a07-84a3-9231297f734b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.217969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.218875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:09.219477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.219763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.220043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.233849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.236478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:09.253978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:09.254989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:09.255875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:09.257217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 334/675] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:09.257496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.261167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b60885b-51bc-49ef-b17f-e1ea5f343c19 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.262645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:09.305290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.306329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.306982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.307483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.308301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:09.308782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.310780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.330489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 342/676] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:09.331216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.381645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe52022e-4b12-431b-927a-a7d9b758817d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.425594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.425936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.426562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.426562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.427580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:09.427580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.428769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.456702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 335/677] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:09.456702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.464175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cf508a-18fb-4126-880f-2ea73b7e509d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.502884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:09.509931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.510543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.510926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.517360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.517360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:09.517360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.517360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.526208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 343/678] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:09.529333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.545779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:09.586149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7646284d-90a2-4de5-b59b-7c407322f47b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.623575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.624531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.624978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.625403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.633293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.634725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:09.646386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:09.647532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:09.648468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:09.652790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 336/679] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:09.652790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.686702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15f1699-7fbd-4101-bf84-8ddd6c261648 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.729850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1df71-6561-4cea-9cdf-b1eb93e36015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.730499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1df71-6561-4cea-9cdf-b1eb93e36015 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.730788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1df71-6561-4cea-9cdf-b1eb93e36015 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.731085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1df71-6561-4cea-9cdf-b1eb93e36015 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.737923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1df71-6561-4cea-9cdf-b1eb93e36015 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.739416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad1df71-6561-4cea-9cdf-b1eb93e36015 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0ad1df71-6561-4cea-9cdf-b1eb93e36015 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:09.750587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:09.751662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:09.752567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:09.756538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 344/680] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:09.757762 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126694d0-8af3-4566-aea8-217550dd25a5 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.758101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126694d0-8af3-4566-aea8-217550dd25a5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.758314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126694d0-8af3-4566-aea8-217550dd25a5 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.763308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 345/681] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:09.763308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126694d0-8af3-4566-aea8-217550dd25a5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.770443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ab6cb-0394-4131-a97f-04f3ef497c40 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.796564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:09.809112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.810323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.810614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.810925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.811773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=cc7c77697ae44017bfb40f9c77ffea1c) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:09.811971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.813406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.816767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:09.827258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 337/682] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/role_assignments?user.id=cc7c77697ae44017bfb40f9c77ffea1c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:09.827258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:09.890008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126694d0-8af3-4566-aea8-217550dd25a5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.947676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d17b053-a426-4a25-aa5a-a12eee73a4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:09.949558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b053-a426-4a25-aa5a-a12eee73a4ce None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.949888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b053-a426-4a25-aa5a-a12eee73a4ce None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.950189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d17b053-a426-4a25-aa5a-a12eee73a4ce None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:09.952217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17b053-a426-4a25-aa5a-a12eee73a4ce None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:09.953157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17b053-a426-4a25-aa5a-a12eee73a4ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:09.957390 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d17b053-a426-4a25-aa5a-a12eee73a4ce None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:09.980357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e3afc2-c4dd-480c-bf87-e5503866f86e None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:09.993817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 346/683] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:09.997888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12381dd-1ed8-4e5f-b66b-c436430514e1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:09.998374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12381dd-1ed8-4e5f-b66b-c436430514e1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:09.999007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12381dd-1ed8-4e5f-b66b-c436430514e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.024851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d12381dd-1ed8-4e5f-b66b-c436430514e1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:10.025042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:10.025618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:10.025905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:10.026011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d12381dd-1ed8-4e5f-b66b-c436430514e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:10.026189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.026920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:10.027231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:10.028887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:10.045176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 338/684] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:10.046166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:10.103803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:10.107329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 347/685] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:10.108515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12381dd-1ed8-4e5f-b66b-c436430514e1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:10.177722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:10.192921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd17768-cdc9-4a13-a321-1caa9bdd5f07 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:10.255034 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:10.255648 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:10.255972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:10.256250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.293825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12381dd-1ed8-4e5f-b66b-c436430514e1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:10.362192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:10.363123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:10.363553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:10.363975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.364998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=60b49283ccd0414389601e5e6f339c45) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:10.365509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:10.367503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:10.375168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 348/686] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/role_assignments?user.id=60b49283ccd0414389601e5e6f339c45&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 608 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:10.384184 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:10.385806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:10.452178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:10.456243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:10.538076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 339/687] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:10.548848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:10.610889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97eea6-c272-435e-b978-8396eca33c3c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:10.613363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:10.651910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:10.652848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:10.654631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:10.655121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.668901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:10.674954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:10.676144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:10.677020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:10.679545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 349/688] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:10.685747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:10.702204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ede7e5-d438-43dd-b8b7-d5986a35369a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:10.745685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:10.746646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:10.747167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:10.747618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.758629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:10.760333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:10.769890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:10.777463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:10.786724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:10.787668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:10.787668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:10.787668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:10.787668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 340/689] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:10.787668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:10.814493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51a31c5-d30c-4c50-aa2e-6701d72a3267 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:10.852053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:10.852674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:10.852952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:10.853223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.853884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:10.854184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:10.855586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:10.866205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 350/690] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:10.875882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:10.901070 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bc68a1-f577-479b-bc4c-4f63236b9cff None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:10.938746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:10.939764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:10.940279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:10.940752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:10.941596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:10.942117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:10.943721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:10.944273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:10.957293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 341/691] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:10.962647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:11.029058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:11.052534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b85ca79-e8c9-4452-9e46-9211f741489a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:11.073458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d14792-a5c7-42f2-9aa9-4a3034e0abdd None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:11.090623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:11.090623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.090623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.090623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.116080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:11.116321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:11.117113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.117462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.117806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.118920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:11.126747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:11.128356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:11.151145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:11.152199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:11.153059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:11.154012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:11.154877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:11.155758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:11.155758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:11.155758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:11.155933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 342/692] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:11.158947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 351/693] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:11.164054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:11.164726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:11.308069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:11.335976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6577f6-7d1c-4191-a33e-9a9aa7109e4c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:11.349728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139678fd-e4c5-4202-9a58-c51cb441cc45 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:11.378122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:11.378742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.380250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.380250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.380589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:11.380907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:11.382848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:11.390804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:11.400233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 352/694] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:11.407829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:11.413659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:11.414379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.414666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.414983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.415720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:11.416028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:11.417797 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:11.430345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 343/695] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:11.435975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:11.591871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8ae84-c44f-4cba-bb35-57987c39fd25 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:11.596078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5c0f16-dab4-44ae-9db8-bf0fc214cc11 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:11.632877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b126700-0ce6-4cef-8b6e-3c3a3d4f1a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:11.633477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b126700-0ce6-4cef-8b6e-3c3a3d4f1a74 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.633754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b126700-0ce6-4cef-8b6e-3c3a3d4f1a74 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.634025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b126700-0ce6-4cef-8b6e-3c3a3d4f1a74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.634745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b126700-0ce6-4cef-8b6e-3c3a3d4f1a74 None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=c1dfd6a8d9194f7a949a77207931eb15) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:11.635077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b126700-0ce6-4cef-8b6e-3c3a3d4f1a74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:11.636493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b126700-0ce6-4cef-8b6e-3c3a3d4f1a74 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:11.638393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:11.639129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.639963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.640253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.642999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 344/696] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:11 2022] GET /identity/v3/role_assignments?user.id=c1dfd6a8d9194f7a949a77207931eb15&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:11.644308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e0c29-8fb1-44be-a011-32da6bf87ee7 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.644597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e0c29-8fb1-44be-a011-32da6bf87ee7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.644865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46e0c29-8fb1-44be-a011-32da6bf87ee7 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.650576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 345/697] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:11.651335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:11.652211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754c9a6-7537-4dfc-8759-7f84dc23b9bc None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.652502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754c9a6-7537-4dfc-8759-7f84dc23b9bc None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.652781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d754c9a6-7537-4dfc-8759-7f84dc23b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.658622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:11.661398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:11.681585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:11.682699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:11.685201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:11.686142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d754c9a6-7537-4dfc-8759-7f84dc23b9bc None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:11.686273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 353/698] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:38:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:11.686385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d754c9a6-7537-4dfc-8759-7f84dc23b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:11.699114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:11.748303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:11.832594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 346/699] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:38:11.866383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aeded4-57a9-48d0-b8ff-b1411ee132ab None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:11.908274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af36598d-8b54-401f-8b0e-3a7195935c34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:11.908893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36598d-8b54-401f-8b0e-3a7195935c34 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:11.909177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36598d-8b54-401f-8b0e-3a7195935c34 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:11.909446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af36598d-8b54-401f-8b0e-3a7195935c34 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:11.910185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36598d-8b54-401f-8b0e-3a7195935c34 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:11.910491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36598d-8b54-401f-8b0e-3a7195935c34 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:11.912006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af36598d-8b54-401f-8b0e-3a7195935c34 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:11.933755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 354/700] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:38:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:11.940267 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754c9a6-7537-4dfc-8759-7f84dc23b9bc None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:12.081361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d754c9a6-7537-4dfc-8759-7f84dc23b9bc None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:12.119552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:12.120546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.121159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.121710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.162053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5105-6c09-4cd7-9b3d-d58cd43ff14a None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.162364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5105-6c09-4cd7-9b3d-d58cd43ff14a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.162621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aa5105-6c09-4cd7-9b3d-d58cd43ff14a None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.164227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 355/701] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:12.172153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44646-36dd-485e-a863-ff456d269e9e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.172439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44646-36dd-485e-a863-ff456d269e9e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.172717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb44646-36dd-485e-a863-ff456d269e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.174245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.197557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5bb44646-36dd-485e-a863-ff456d269e9e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:12.198810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5bb44646-36dd-485e-a863-ff456d269e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:12.207651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:12.208984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:12.262487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.301119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 356/702] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:38:12.302362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44646-36dd-485e-a863-ff456d269e9e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:12.411654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 347/703] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:12.418098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:12.425512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb44646-36dd-485e-a863-ff456d269e9e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:12.467003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:12.467650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.467934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.468208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.480932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:12.483156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:12.500806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:12.501798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:12.503693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:12.503693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:12.503693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:12.503693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 357/704] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:12.507749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:12.583135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.583635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.619802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc4c6e-b120-4e95-b365-efdfb9aa0859 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:12.662897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:12.662897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.663154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.663248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.677889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:12.680254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:12.691668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849778-22ae-424b-a377-dd99ae77de81 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:12.702906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:12.703933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:12.704815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:12.704815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:12.704815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:12.704815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 348/705] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:12.705527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:12.751505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:12.752428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.752713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.753021 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.754104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:12.754409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:12.756109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:12.782162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 358/706] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:12.783178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:12.835025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de7318-3966-4711-9c9e-6a693fe9adfb None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:12.865022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.873820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:12.874450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.874729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.875033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.875665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:12.876983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:12.888547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:12.889902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:12.890987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 349/707] 10.222.0.59 () {56 vars in 1129 bytes} [Wed Aug 24 06:38:12 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:12.891915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:12.898060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:12.904755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0330187-64dc-4700-89c5-f6e00c87552b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:12.946450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84664e7e-1058-4842-b356-ae11d25c9ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:12.947009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664e7e-1058-4842-b356-ae11d25c9ef5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.947294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664e7e-1058-4842-b356-ae11d25c9ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.947570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84664e7e-1058-4842-b356-ae11d25c9ef5 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.948232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84664e7e-1058-4842-b356-ae11d25c9ef5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:12.948579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84664e7e-1058-4842-b356-ae11d25c9ef5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:12.951081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84664e7e-1058-4842-b356-ae11d25c9ef5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:12.971271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 359/708] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:12.972727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe162c28-cd72-4c15-a76b-ab7abcd75abd None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:12.973018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe162c28-cd72-4c15-a76b-ab7abcd75abd None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:12.973298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe162c28-cd72-4c15-a76b-ab7abcd75abd None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:12.979013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 360/709] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:12.980252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe162c28-cd72-4c15-a76b-ab7abcd75abd None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:13.014431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1ae46-49d7-43d1-a9da-6b09eb473234 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.055659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761ef54-5606-4467-8a00-ffec18fca132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:13.056527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761ef54-5606-4467-8a00-ffec18fca132 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.056963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761ef54-5606-4467-8a00-ffec18fca132 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.057411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761ef54-5606-4467-8a00-ffec18fca132 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.058238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761ef54-5606-4467-8a00-ffec18fca132 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:13.060467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761ef54-5606-4467-8a00-ffec18fca132 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:13.096474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe162c28-cd72-4c15-a76b-ab7abcd75abd None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.131347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:13.131952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.132230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.132500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.133126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:13.133423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:13.134801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:13.139681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 361/710] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 06:38:12 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:13.140469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:13.158802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 350/711] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:38:12 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:13.158802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba39f7-8cd9-4562-9028-c7dc4c688a44 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.158802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba39f7-8cd9-4562-9028-c7dc4c688a44 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.158802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba39f7-8cd9-4562-9028-c7dc4c688a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.167524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:13.188942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-74ba39f7-8cd9-4562-9028-c7dc4c688a44 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:13.190534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-74ba39f7-8cd9-4562-9028-c7dc4c688a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:13.252989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf04c27-1acf-4304-bed4-3d9562fc2e90 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.253799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:13.290933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 351/712] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:13.293237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba39f7-8cd9-4562-9028-c7dc4c688a44 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:13.316922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:13.317371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.317655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.317929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.325803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:13.327384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:13.340619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:13.341595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:13.342515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 362/713] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:13.352072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:13.437646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba39f7-8cd9-4562-9028-c7dc4c688a44 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.476642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:13.503347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:13.504497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.504947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.505227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.505890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:13.506198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:13.506627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f67b7-0ab2-45ec-a375-218d0de2d2b4 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.507649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:13.514680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 352/714] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 06:38:13 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:13.555175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:13.555809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.556087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.556359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.557067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:13.557370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:13.560854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:13.575817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 363/715] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:13.581588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:13.617333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:13.646660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:13.725874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951de88-39c0-4c38-bd42-d123b76e28af None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.762842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357c26b1-85c0-4e4d-a535-3167cc9f7ee7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.767943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:13.768634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.768923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.769198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.769941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=2a68d368b5d14b75aaba3bbb3f4bb62c) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:13.770250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:13.771960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:13.783237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 353/716] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:13 2022] GET /identity/v3/role_assignments?user.id=2a68d368b5d14b75aaba3bbb3f4bb62c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:13.808090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:13.812050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:13.812050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:13.812050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] PATH_INFO: `/v3/services/network` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:13.812050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:13.812406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:13.825035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:13.826960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:13.828043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 364/717] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:13 2022] GET /identity/v3/services/network => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:13.832417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:13.961375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff271d52-e11f-407b-8173-2fefc1d61e95 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:13.963900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:14.005460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed77752a-abd0-4783-aeec-1fc61e3f5b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:14.006089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77752a-abd0-4783-aeec-1fc61e3f5b2f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:14.006372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77752a-abd0-4783-aeec-1fc61e3f5b2f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:14.006648 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed77752a-abd0-4783-aeec-1fc61e3f5b2f None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:14.007359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77752a-abd0-4783-aeec-1fc61e3f5b2f None admin] RBAC: Adding query filter params (name=network) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:14.007665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77752a-abd0-4783-aeec-1fc61e3f5b2f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:14.009265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed77752a-abd0-4783-aeec-1fc61e3f5b2f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:14.014649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 354/718] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:14.019861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:14.025967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:14.165270 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf8b9b-0818-4c36-a8ce-d9ed767fbdbb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:14.216232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:14.217109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:14.217534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:14.217980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:14.218783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] RBAC: Adding query filter params (type=network) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:14.219226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:14.220742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:14.224277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251d14-0179-48c8-a286-0f464bb83839 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:14.224277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251d14-0179-48c8-a286-0f464bb83839 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:14.224277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6251d14-0179-48c8-a286-0f464bb83839 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:14.225218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 355/719] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:14.230746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 365/720] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:14 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:14.232137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ea9a-0d20-4c94-aab4-5daac6926300 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:14.232554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ea9a-0d20-4c94-aab4-5daac6926300 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:14.232938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521ea9a-0d20-4c94-aab4-5daac6926300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:14.266413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f521ea9a-0d20-4c94-aab4-5daac6926300 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:14.267817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f521ea9a-0d20-4c94-aab4-5daac6926300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:14.350131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 356/721] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:38:14.667688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:14.761217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:14.808404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80e6e0-563c-4e75-a1c4-54662639bfef None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:14.859200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:14.860200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:14.860712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:14.861219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:14.874798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:14.880235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:14.881197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:14.882049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:14.884341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 366/722] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:14.890540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ea9a-0d20-4c94-aab4-5daac6926300 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:15.002513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:15.010861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521ea9a-0d20-4c94-aab4-5daac6926300 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:15.057730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:15.058345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:15.058632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:15.058938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:15.060173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:15.060482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:15.061857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:15.070780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 357/723] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:15.076178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:15.231790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d50d39d-3d27-4360-8e5e-c17bcebbab17 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:15.269237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:15.277182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:15.277815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:15.278156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:15.278433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:15.295764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:15.297220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:15.314487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:15.315471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:15.316426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:15.316426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:15.316426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:15.316426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 367/724] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:15.321541 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:15.492970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79159a82-0667-46b1-8f7d-e370e1fb40c9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:15.542450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:15.543081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:15.543362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:15.544358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:15.545010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:15.545316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:15.546686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:15.567330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 358/725] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:15.573129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:15.708038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91b38a-0b1f-4c61-b9aa-944462c28853 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:15.751496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d12555-3827-432e-9209-c6b4ac805f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:15.752139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12555-3827-432e-9209-c6b4ac805f32 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:15.752415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12555-3827-432e-9209-c6b4ac805f32 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:15.752685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d12555-3827-432e-9209-c6b4ac805f32 None admin] PATH_INFO: `/v3/users/swift` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:15.767926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d12555-3827-432e-9209-c6b4ac805f32 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:15.769394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d12555-3827-432e-9209-c6b4ac805f32 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-15d12555-3827-432e-9209-c6b4ac805f32 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:15.784275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:15.785380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:15.786365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 368/726] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:15.791483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:15.802784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974742be-26e4-4c12-86d8-81999499d3ec None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:15.803098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974742be-26e4-4c12-86d8-81999499d3ec None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:15.803251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974742be-26e4-4c12-86d8-81999499d3ec None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:15.805082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 369/727] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:15.811168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc75ed8-58a1-47ac-8d0e-1f5fe07cec4d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:15.811531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc75ed8-58a1-47ac-8d0e-1f5fe07cec4d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:15.811815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc75ed8-58a1-47ac-8d0e-1f5fe07cec4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:15.830963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:15.835005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-8fc75ed8-58a1-47ac-8d0e-1f5fe07cec4d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:15.836291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8fc75ed8-58a1-47ac-8d0e-1f5fe07cec4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:15.875961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:15.922918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 370/728] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 24 06:38:16.009021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3a31a2-e4ea-4a8b-9986-315d6f69c880 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:16.013787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b742-ce52-4244-8d77-cc39174b240d None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.014081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b742-ce52-4244-8d77-cc39174b240d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.014347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7615b742-ce52-4244-8d77-cc39174b240d None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.018899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 371/729] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:16.025216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc77cf-f559-4bb6-8f2c-c83e8bcbdc73 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.025486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc77cf-f559-4bb6-8f2c-c83e8bcbdc73 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.025777 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc77cf-f559-4bb6-8f2c-c83e8bcbdc73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.054175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d0cc77cf-f559-4bb6-8f2c-c83e8bcbdc73 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:16.054469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:16.055101 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.055330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d0cc77cf-f559-4bb6-8f2c-c83e8bcbdc73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:16.055512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.055659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.056360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:16.056662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:16.058090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:16.094002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 359/730] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 06:38:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:16.099627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:16.148446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 372/731] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:16.203035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:16.229646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b664d0a-2e37-4680-a58e-2d9e8e239f52 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:16.242990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc77cf-f559-4bb6-8f2c-c83e8bcbdc73 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:16.291345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:16.292216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.292501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.292776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.386328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:16.389918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc77cf-f559-4bb6-8f2c-c83e8bcbdc73 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:16.424228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:16.425693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:16.426038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:16.426685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.426984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.427262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.438153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:16.442927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:16.443847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:16.444664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 373/732] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:16.445344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:16.535980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:16.564443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f11ad32-65f0-4866-9256-d91c410b0c2a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:16.565905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 360/733] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 24 06:38:16.566877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:16.604629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d4616-7c98-4f4a-a64f-4e0268987a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:16.605418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4616-7c98-4f4a-a64f-4e0268987a70 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.606677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4616-7c98-4f4a-a64f-4e0268987a70 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.607092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d4616-7c98-4f4a-a64f-4e0268987a70 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.607841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d4616-7c98-4f4a-a64f-4e0268987a70 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:16.609715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d4616-7c98-4f4a-a64f-4e0268987a70 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:16.676247 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fde8190-e151-4437-96d4-d34137838b4e None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:16.716212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828e0597-04e2-4f8c-a601-5eda4971c155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:16.716849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0597-04e2-4f8c-a601-5eda4971c155 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.717133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0597-04e2-4f8c-a601-5eda4971c155 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.717407 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828e0597-04e2-4f8c-a601-5eda4971c155 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.718574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0597-04e2-4f8c-a601-5eda4971c155 None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:16.718574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0597-04e2-4f8c-a601-5eda4971c155 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:16.719765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828e0597-04e2-4f8c-a601-5eda4971c155 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:16.723423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 374/734] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:16 2022] POST /identity/v3/services => generated 251 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:16.724505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5d6cc-0330-4580-a148-786c7370bf8a None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.724805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5d6cc-0330-4580-a148-786c7370bf8a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.725087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce5d6cc-0330-4580-a148-786c7370bf8a None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.726659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 375/735] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:16.727407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5d6cc-0330-4580-a148-786c7370bf8a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:16.735431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 361/736] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:16.736506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1815dde-c1dd-43b4-9365-0a16684c9ce6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:16.736801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1815dde-c1dd-43b4-9365-0a16684c9ce6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:16.737082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1815dde-c1dd-43b4-9365-0a16684c9ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:16.763854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:16.766130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e1815dde-c1dd-43b4-9365-0a16684c9ce6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:16.767517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e1815dde-c1dd-43b4-9365-0a16684c9ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:16.825399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:16.877333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 362/737] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:16 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:16.878302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1815dde-c1dd-43b4-9365-0a16684c9ce6 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.036256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce5d6cc-0330-4580-a148-786c7370bf8a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.086442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911b815-fdc1-490d-abd5-3ed72e521811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.087560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911b815-fdc1-490d-abd5-3ed72e521811 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.087944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911b815-fdc1-490d-abd5-3ed72e521811 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.088667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911b815-fdc1-490d-abd5-3ed72e521811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.102602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911b815-fdc1-490d-abd5-3ed72e521811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:17.104257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d911b815-fdc1-490d-abd5-3ed72e521811 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:17.105120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1815dde-c1dd-43b4-9365-0a16684c9ce6 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d911b815-fdc1-490d-abd5-3ed72e521811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:17.120845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:17.122005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:17.123904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:17.123904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:17.123904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:17.123904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 376/738] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:17.124434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050d08-0775-4edd-97f2-466328c87026 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.126378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050d08-0775-4edd-97f2-466328c87026 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.126378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd050d08-0775-4edd-97f2-466328c87026 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.130424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 377/739] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:17.131463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd050d08-0775-4edd-97f2-466328c87026 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.142591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb67d04-c85b-4222-af1a-6a8c224ae0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.143346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67d04-c85b-4222-af1a-6a8c224ae0fb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.143631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67d04-c85b-4222-af1a-6a8c224ae0fb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.143906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb67d04-c85b-4222-af1a-6a8c224ae0fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.156336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb67d04-c85b-4222-af1a-6a8c224ae0fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:17.157871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb67d04-c85b-4222-af1a-6a8c224ae0fb None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-0bb67d04-c85b-4222-af1a-6a8c224ae0fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:17.174500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:17.175762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:17.176815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:17.176815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:17.176815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:17.176815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 363/740] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:17.180618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352865-4e3e-48ae-809a-2eca984e2c8f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.180618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352865-4e3e-48ae-809a-2eca984e2c8f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.180618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9352865-4e3e-48ae-809a-2eca984e2c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.196167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e9352865-4e3e-48ae-809a-2eca984e2c8f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:17.197387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e9352865-4e3e-48ae-809a-2eca984e2c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:17.212661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:17.218895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:17.255878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd050d08-0775-4edd-97f2-466328c87026 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.282789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 364/741] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:17 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 24 06:38:17.282789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9352865-4e3e-48ae-809a-2eca984e2c8f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.311514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.312280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.313469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.313754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.314406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:17.314708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:17.316175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:17.389070 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9352865-4e3e-48ae-809a-2eca984e2c8f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.428419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.429268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.429657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.430067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.444578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:17.450393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:17.451601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:17.453195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:17.458618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 365/742] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:17.459636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.472388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:17.476528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 378/743] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:17.477377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.572544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5f35d-7dd4-4139-817c-5ee068e1ccff None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.603605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319c7122-8367-45ed-831a-da4c262bb111 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.610447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.611211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.611374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.611633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.612276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:17.612582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:17.613969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:17.630344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 366/744] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:17.630344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.640154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:17.647519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.648137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.648420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.648695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.649402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:17.649664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:17.651056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:17.660283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 379/745] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:17.661349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.720091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:17.761876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42978f74-2d8f-43e6-8a72-76213ed03d17 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.784860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd4cd6-2971-4c3a-b82c-6071ec03e08e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:17.801309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.802078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.802362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.802629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.811329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:17.812861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:17.826449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:17.827532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:17.828593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:17.830624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:17.831148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:17.831433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:17.831914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:17.832410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 367/746] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:17.832770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:17.833360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.834171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:17.919034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 380/747] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:17 2022] POST /identity/v3/services => generated 240 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:17.920725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:17.963831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a1843c-f473-4cec-b609-c27cf87c352a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.003391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.018108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.028532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.029733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.032220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.032939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.043837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.045467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:18.057765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:18.058852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:18.060396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 368/748] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:38:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:18.061018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:18.082261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e992bb-4e39-47c9-9e6d-380c69f10403 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.125240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.125889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.126174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.126448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.139516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.140800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:18.156616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:18.157622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:18.158554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:18.158554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:18.158554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:18.158554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 381/749] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:18.158822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:18.186927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72255b60-3800-45b7-a1c5-33def097bcda None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.223564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.224548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.225032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.225507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.226432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:18.226961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.228609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.242661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 369/750] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:18.249347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:18.299374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee0d2dd-463b-4d75-94a6-aa9497b0e025 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.301240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.310658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.353035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.353587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.353872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.354296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.355664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:18.357932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.359675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.373199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1c156b-4cd9-4c51-a5ee-2222b05ddef1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.381483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 382/751] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 06:38:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:18.382758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:18.424545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.426238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.426528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.426870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.427564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:18.427941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.429381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.446853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 370/752] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:18.448160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:18.514429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d10bb57-16da-47e3-b232-84613f808d43 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.562739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.563774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.564529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.564905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.565748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=c1dfd6a8d9194f7a949a77207931eb15) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:18.566144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.567675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.581061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 383/753] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:18 2022] GET /identity/v3/role_assignments?user.id=c1dfd6a8d9194f7a949a77207931eb15&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:18.581061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:18.588945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37862d4a-07fd-415b-960c-0818f00c96af None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.597601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.645826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.674188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6554652-8e93-4ab2-ae37-087650eb6ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.674827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554652-8e93-4ab2-ae37-087650eb6ef3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.675111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554652-8e93-4ab2-ae37-087650eb6ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.675386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6554652-8e93-4ab2-ae37-087650eb6ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.786648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a266159-8aa7-440a-b649-7b070d4f0127 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:18.796825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6554652-8e93-4ab2-ae37-087650eb6ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.798293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6554652-8e93-4ab2-ae37-087650eb6ef3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.830372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e29b2-3f2b-49b0-aa9e-6f9bababa845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:18.831069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e29b2-3f2b-49b0-aa9e-6f9bababa845 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.831365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e29b2-3f2b-49b0-aa9e-6f9bababa845 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.831831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e29b2-3f2b-49b0-aa9e-6f9bababa845 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.839273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e29b2-3f2b-49b0-aa9e-6f9bababa845 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:18.841468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426e29b2-3f2b-49b0-aa9e-6f9bababa845 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-426e29b2-3f2b-49b0-aa9e-6f9bababa845 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:18.853515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:18.854911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 384/754] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:38:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:18.856396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8dc98-f7ab-4249-862f-b512c6ada48c None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.857101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8dc98-f7ab-4249-862f-b512c6ada48c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.857101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a8dc98-f7ab-4249-862f-b512c6ada48c None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.858807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 385/755] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:18.860314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8dc98-f7ab-4249-862f-b512c6ada48c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:18.935701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 371/756] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:18.935701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff2881-9082-454b-8fd3-998d25acbd70 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:18.935701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff2881-9082-454b-8fd3-998d25acbd70 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:18.935701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff2881-9082-454b-8fd3-998d25acbd70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:18.941795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.955582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-9bff2881-9082-454b-8fd3-998d25acbd70 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:18.957283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9bff2881-9082-454b-8fd3-998d25acbd70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:18.967927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:18.989427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a8dc98-f7ab-4249-862f-b512c6ada48c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.035519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.036148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.036429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.036706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.037760 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:19.038077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.039609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.050252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 372/757] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:18 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:19.051800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff2881-9082-454b-8fd3-998d25acbd70 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.061188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 386/758] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:38:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:19.066423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.174640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89250a63-502b-4c29-949b-a613bb0d1e64 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.209805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.210370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.210655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.210963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.222853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.223561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.239185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff2881-9082-454b-8fd3-998d25acbd70 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:19.239698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:19.240605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:19.242116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:19.242116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:19.242116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:19.242116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 387/759] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:19.242843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:19.246028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.355567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac06c33-7fd6-43df-a0bb-869badc26aa1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.376022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.376675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.376955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.377230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.379506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:19.415953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.417688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.432851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.433475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.433760 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.434070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.434725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:19.435053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.436463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:19.455060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:19.456088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:19.457013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:19.457013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:19.457013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:19.457013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 373/760] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 405 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:19.463912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 388/761] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:19.466132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.469581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.547393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:19.592193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619626c-4312-4ad9-a137-c77b1663edc6 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.602142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b3061-436b-45ba-ad55-a4b533ad5965 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.636577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.637924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.638681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.639720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.648629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.649251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.649538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.649819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.650045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.650474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:19.650801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.652174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.652285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:19.667311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:19.668810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:19.669726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:19.672313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 389/763] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:19.673621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.676188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 374/763] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:19.677376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.757769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:19.853625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceef96-bfd4-496c-9078-2f4a782af830 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.861360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21266d9f-7194-4a5a-a782-3f447c9343b7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:19.876018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:19.908812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.909444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.909738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.910025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.910643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.916328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.920339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:19.921914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:19.923218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:19.923909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:19.933391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:19.935124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:19.935940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 390/764] 10.222.0.59 () {56 vars in 1129 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:19.936813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:19.939287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:19.943033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:19.967912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:19.968830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:19.969812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:19.972530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 375/765] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:19.973602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.104639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f91408a-be76-402d-a0d2-160d93430632 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:20.138124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4579478d-bfe5-448e-bfd0-4cf9a1998d05 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:20.146377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:20.158888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:20.159937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.160347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.160706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.161568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:20.161880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:20.163426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:20.177204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 391/766] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:20.178073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.189165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec900086-1f10-44c7-bf95-1d4ba6c0e7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:20.189908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900086-1f10-44c7-bf95-1d4ba6c0e7f4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.190219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900086-1f10-44c7-bf95-1d4ba6c0e7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.190495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec900086-1f10-44c7-bf95-1d4ba6c0e7f4 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.191251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec900086-1f10-44c7-bf95-1d4ba6c0e7f4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:20.191621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec900086-1f10-44c7-bf95-1d4ba6c0e7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:20.193292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec900086-1f10-44c7-bf95-1d4ba6c0e7f4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:20.203518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 376/767] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 06:38:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:20.206280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46be194-f565-4c3b-8d14-e25abd39974c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.206855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46be194-f565-4c3b-8d14-e25abd39974c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.207344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46be194-f565-4c3b-8d14-e25abd39974c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.209370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 377/768] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:20.210667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46be194-f565-4c3b-8d14-e25abd39974c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.232256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:20.296316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b187681-5c7d-4ed4-96bb-1926ae73162a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:20.322234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46be194-f565-4c3b-8d14-e25abd39974c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:20.333157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:20.333757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.334030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.334296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.335498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:20.335498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:20.336741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:20.354152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 392/769] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:20.354152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.365427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee19a9f5-b95b-4c4b-a9a5-990310bbf58f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:20.366098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19a9f5-b95b-4c4b-a9a5-990310bbf58f None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.366381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19a9f5-b95b-4c4b-a9a5-990310bbf58f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.366661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee19a9f5-b95b-4c4b-a9a5-990310bbf58f None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/2a68d368b5d14b75aaba3bbb3f4bb62c/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.368646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19a9f5-b95b-4c4b-a9a5-990310bbf58f None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=2a68d368b5d14b75aaba3bbb3f4bb62c, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:20.370172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee19a9f5-b95b-4c4b-a9a5-990310bbf58f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:20.426054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 378/770] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:20 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/2a68d368b5d14b75aaba3bbb3f4bb62c/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:38:20.427414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce124f6e-e926-4a80-959c-34296663f044 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.427703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce124f6e-e926-4a80-959c-34296663f044 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.427979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce124f6e-e926-4a80-959c-34296663f044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.448363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ce124f6e-e926-4a80-959c-34296663f044 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:20.449674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ce124f6e-e926-4a80-959c-34296663f044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:20.472855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec3a787-bdc5-4a4f-887a-11b27eeff39b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:20.475696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:20.479780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:20.530300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:20.531257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.531758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.532219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.533058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:20.533551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:20.535595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:20.537805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 379/771] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:20.539279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce124f6e-e926-4a80-959c-34296663f044 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.542828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 393/772] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 06:38:20 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:20.550926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.674829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce124f6e-e926-4a80-959c-34296663f044 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:20.715570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7dde3-b63a-471f-abe0-2cf0fcd33193 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:20.740052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b905bc-de51-4eb2-8b8c-0b35c956067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:20.740929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b905bc-de51-4eb2-8b8c-0b35c956067a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.741359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b905bc-de51-4eb2-8b8c-0b35c956067a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.741799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b905bc-de51-4eb2-8b8c-0b35c956067a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.742676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b905bc-de51-4eb2-8b8c-0b35c956067a None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=59375961363e484ca6607126bbf0741b) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:20.743158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b905bc-de51-4eb2-8b8c-0b35c956067a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:20.744808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b905bc-de51-4eb2-8b8c-0b35c956067a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:20.753432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 380/773] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:20 2022] GET /identity/v3/role_assignments?user.id=59375961363e484ca6607126bbf0741b&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:20.754999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08ef9d-9c1c-4432-961e-01f3bdc168aa None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.755431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08ef9d-9c1c-4432-961e-01f3bdc168aa None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.756438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e08ef9d-9c1c-4432-961e-01f3bdc168aa None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.758641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 381/774] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:20.765118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c25b-f09e-4f2c-a7a7-2378e3f276e3 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.765547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c25b-f09e-4f2c-a7a7-2378e3f276e3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.765938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108c25b-f09e-4f2c-a7a7-2378e3f276e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.786571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:20.787606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:20.789166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:20.789631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:20.790537 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] RBAC: Adding query filter params (interface=public, service_id=1227cf67dcf3443e976f2cc7a44c020d, region_id=RegionOne) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:20.791858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:20.794308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:20.794985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d108c25b-f09e-4f2c-a7a7-2378e3f276e3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:20.796502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d108c25b-f09e-4f2c-a7a7-2378e3f276e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:20.816207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 394/775] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:38:20 2022] GET /identity/v3/endpoints?service_id=1227cf67dcf3443e976f2cc7a44c020d&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:20.822005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.858911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:20.891634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:20.926226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 382/776] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:20.927628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c25b-f09e-4f2c-a7a7-2378e3f276e3 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:20.976147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c61b24-74fb-4f81-a2b3-e50fac5dc9bb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.033312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.033960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.034243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.034516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.035163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:21.036648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:21.047231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 395/777] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:20 2022] GET /identity/v3/services => generated 772 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:21.193881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108c25b-f09e-4f2c-a7a7-2378e3f276e3 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.242910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:21.254108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.255143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.255623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.256111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] PATH_INFO: `/v3/services/network` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.256926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:21.258526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:21.268391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:21.269453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:21.270270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:21.273159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 383/778] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:20 2022] GET /identity/v3/services/network => generated 88 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:21.278995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:21.306579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:21.420716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:21.430988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f1d21-3b6d-43b0-9088-7a2df7d585e0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.431997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f392c3c5-a3df-450a-8652-667bfe54d46f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.476748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.478616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.479141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.479611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.480444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] RBAC: Adding query filter params (name=network) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:21.481000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:21.482593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:21.488830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 384/779] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:21 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:21.493940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:21.507573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.508220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.508500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.508775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.529257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:21.534017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:21.535087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:21.536319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 396/780] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:21.547095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:21.618699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:21.639060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4cc7c5-0e54-4a9a-bee1-ada00f5979b6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.675149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.675926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.676318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.676934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.677679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] RBAC: Adding query filter params (type=network) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:21.678090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:21.679621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:21.685556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 385/781] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:21 2022] GET /identity/v3/services?type=network => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:21.691539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:21.737741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c6b25-2dbe-4732-82b7-b0f9e9c89c04 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.792878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b8f2d-49f0-4829-84fe-894ff035d31d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.811482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.812114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.812400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.812676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.813354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:21.813661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:21.815071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:21.829316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.829975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 397/782] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:21.830280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.830579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.830907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.831689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] RBAC: Adding query filter params (interface=public, service_id=87755cc9d10042b9936f7aedc3c43e08, region_id=RegionOne) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:21.832032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:21.833412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:21.836587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:21.842653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 386/783] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:38:21 2022] GET /identity/v3/endpoints?service_id=87755cc9d10042b9936f7aedc3c43e08&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:21.848130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:21.876457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:21.883146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:21.959198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbf43d-8958-4f80-b170-db7ccc0f507d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.987414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c9009-f65f-4314-8780-ee44b65be819 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:21.995622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:21.996282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:21.996567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:21.996843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:21.997465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:21.998881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:22.004882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 387/784] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:21 2022] GET /identity/v3/services => generated 772 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:22.032451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:22.033232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:22.033605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:22.033949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:22.046051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:22.047693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:22.064977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:22.065984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:22.067176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:22.067176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:22.067176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:22.067176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 398/785] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:22.072389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:22.211265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:22.250720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ca9c4-b7bc-4948-9831-bfc17cce3705 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:22.293908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:22.294522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:22.294826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:22.295153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:22.295809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:22.296115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:22.297480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:22.310131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 388/786] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:22.315366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:22.394695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:22.437683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4399d904-d176-4b6f-813c-03ccc6a4b4c6 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:22.473286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:22.473867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:22.474144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:22.474414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] PATH_INFO: `/v3/users/swift` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:22.483388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:22.484863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:22.497223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:22.498264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:22.499622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 399/787] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:22.504138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:22.668921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3a14ad-7c63-494e-b3b6-7b0ce0bff0dc None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:22.723564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:22.724151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:22.724440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:22.724717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:22.725467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:22.725809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:22.727291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:22.731166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:22.750957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 389/788] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 06:38:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:22.756250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:22.905435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e249da81-f186-4533-8369-553bef0b40bb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:22.939794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:22.951454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b45a51-57e6-4be8-8985-e87d63aa7af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:22.952105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45a51-57e6-4be8-8985-e87d63aa7af5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:22.952388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45a51-57e6-4be8-8985-e87d63aa7af5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:22.952668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45a51-57e6-4be8-8985-e87d63aa7af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:22.964277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b45a51-57e6-4be8-8985-e87d63aa7af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:22.966256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b45a51-57e6-4be8-8985-e87d63aa7af5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-94b45a51-57e6-4be8-8985-e87d63aa7af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:22.991578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:22.993076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:22.993979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:22.993979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:22.993979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:22.993979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 400/789] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:23.001013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:23.063096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d40df-e08f-476c-afb3-da256bda886f None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.063419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d40df-e08f-476c-afb3-da256bda886f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.063670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d40df-e08f-476c-afb3-da256bda886f None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.065264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 401/790] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:23.070395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e856ed-ff83-4aad-808c-6ae04f879233 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.070688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e856ed-ff83-4aad-808c-6ae04f879233 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.071064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e856ed-ff83-4aad-808c-6ae04f879233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.103113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-84e856ed-ff83-4aad-808c-6ae04f879233 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:23.104343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-84e856ed-ff83-4aad-808c-6ae04f879233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:23.151910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f3f51b-43c8-4163-b7c1-9d8bc8536c9f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:23.220906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:23.221538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.221821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.222094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.222788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:23.223098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:23.224491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:23.237910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 402/791] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:23.239251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bc6ef-54d2-4989-9dd7-44de69c74155 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.239540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bc6ef-54d2-4989-9dd7-44de69c74155 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.239816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698bc6ef-54d2-4989-9dd7-44de69c74155 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.241346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 403/792] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:23.245223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 390/793] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:23.247654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae51130-fcce-4bae-9ea7-d1d03ba316c0 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.247943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae51130-fcce-4bae-9ea7-d1d03ba316c0 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.248231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae51130-fcce-4bae-9ea7-d1d03ba316c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.251766 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:23.276177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-eae51130-fcce-4bae-9ea7-d1d03ba316c0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:23.277451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-eae51130-fcce-4bae-9ea7-d1d03ba316c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:23.352501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:23.398072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 404/794] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:23.426471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdba37f7-a9e9-42a8-be54-de24dc309e41 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:23.487962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:23.488199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce552de-b580-425a-b1ae-0cebc148e580 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.488438 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce552de-b580-425a-b1ae-0cebc148e580 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.488683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce552de-b580-425a-b1ae-0cebc148e580 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.489465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.490038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.490321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 405/795] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:23.490726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.497364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37add5-2755-4c19-92d7-687638f52009 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.497658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37add5-2755-4c19-92d7-687638f52009 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.497884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c37add5-2755-4c19-92d7-687638f52009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.506892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:23.508447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:23.531872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:23.532827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:23.533729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 391/796] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:23.534233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:23.544195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0c37add5-2755-4c19-92d7-687638f52009 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:23.545995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0c37add5-2755-4c19-92d7-687638f52009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:23.592563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:23.638910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 406/797] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:23.640129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37add5-2755-4c19-92d7-687638f52009 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:23.657550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbeeda0-6733-4993-b200-2a6b4f4d84d7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:23.683993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:23.744958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:23.745768 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.746658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.747110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.772459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:23.779714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:23.780910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:23.781949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:23.784935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 392/798] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:23.786246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:23.800606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c37add5-2755-4c19-92d7-687638f52009 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:23.842266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:23.843095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.843667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.844037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.844852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:23.845217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:23.846722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:23.859904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 407/799] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:23.860872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:23.898467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:23.916556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0c7838-e597-48d1-a435-d1c4ffac6b26 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:23.959424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:23.960426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:23.960972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:23.961595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:23.973460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:23.978322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:23.979320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 393/800] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:23.981016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:23.986173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4837b8-4fea-4c27-9fde-458b19d22687 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.017124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:24.024336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.024918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.025177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.025459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.026240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:24.026477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.028467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.042556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 408/801] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:24.042556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.092710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157a7fe8-01dd-456c-87b6-8e519a51ee0b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.129026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.129683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.129964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.130235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/c1dfd6a8d9194f7a949a77207931eb15/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.132170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=c1dfd6a8d9194f7a949a77207931eb15, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.133595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.138360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:24.146975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4de447-337c-42e5-9b82-d381df0d7040 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.180900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.181524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.181804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.182080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.182658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.184123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:24.192847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:24.197822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:24.198685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 409/802] 10.222.0.59 () {56 vars in 1129 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:24.200053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.210854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 394/803] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:23 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/c1dfd6a8d9194f7a949a77207931eb15/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:38:24.210854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.333919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:24.346265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9471bc5-1ad6-45a3-8fd0-1d72fed248ae None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.367149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a206f4-2e83-4e1d-81a1-811cb3c5e393 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.394619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3759d5-f82f-44af-929b-af0833c18f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.395374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3759d5-f82f-44af-929b-af0833c18f4c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.395658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3759d5-f82f-44af-929b-af0833c18f4c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.395924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3759d5-f82f-44af-929b-af0833c18f4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.407769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3759d5-f82f-44af-929b-af0833c18f4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.409490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3759d5-f82f-44af-929b-af0833c18f4c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.412840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.413326 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.413604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.413878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.414552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:24.414885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.416535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.426171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 410/804] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:24.430909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-5c3759d5-f82f-44af-929b-af0833c18f4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:24.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:24.431928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:24.432821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:24.432821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:24.432821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:24.432821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 395/805] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:24.433062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f852-b580-488a-af02-6d337b2a496a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.433809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f852-b580-488a-af02-6d337b2a496a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.433809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084f852-b580-488a-af02-6d337b2a496a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.435347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 396/806] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:24.437010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f852-b580-488a-af02-6d337b2a496a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.455516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:24.545838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b33cad-de5b-48cb-9f59-4d7b45fc881a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.557597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084f852-b580-488a-af02-6d337b2a496a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.585218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.585758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.586072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.586288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.586952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:24.587252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.588646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.594515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 411/807] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:24.595032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf558939-b331-4961-81a9-6db9bc46c101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.595461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.596052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf558939-b331-4961-81a9-6db9bc46c101 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.596337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf558939-b331-4961-81a9-6db9bc46c101 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.596617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf558939-b331-4961-81a9-6db9bc46c101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.616842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf558939-b331-4961-81a9-6db9bc46c101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.618323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf558939-b331-4961-81a9-6db9bc46c101 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.621682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-cf558939-b331-4961-81a9-6db9bc46c101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:24.634082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:24.643830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:24.645173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:24.645173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:24.645173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:24.645173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 397/808] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:24.645173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b144796-90ce-4177-b8b4-b5b54aeba229 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.645173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b144796-90ce-4177-b8b4-b5b54aeba229 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.645173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b144796-90ce-4177-b8b4-b5b54aeba229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.660565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-2b144796-90ce-4177-b8b4-b5b54aeba229 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:24.662474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2b144796-90ce-4177-b8b4-b5b54aeba229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:24.700224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:24.722845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f921f-6ea8-4e09-b8ef-a12f6dd2bee2 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.738562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 398/809] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:24.739416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b144796-90ce-4177-b8b4-b5b54aeba229 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.763976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.764914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.765625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.766455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.767347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:24.767826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.769938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.787777 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 412/810] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:24.788893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.865318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b144796-90ce-4177-b8b4-b5b54aeba229 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.895185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:24.911194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.911879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.913336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.913336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.913336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:24.913570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.915337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:24.921040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 399/811] 10.222.0.59 () {56 vars in 1124 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:24.922123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:24.931234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e5e61d-88a8-41ec-9606-a04dacce9c2a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:24.981735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:24.983204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:24.984304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:24.984950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:24.986788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:24.987294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:24.989015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.007468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 413/812] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:25.008618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.012094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:25.049660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027574a-e34d-48b7-a024-bd348e38e7ab None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.086277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.087041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.088090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.088090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.095814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.097271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:25.108691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:25.114424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 400/813] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:38:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:25.115792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.129266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36e2c3-2f3c-4744-91a9-ef3fc678f1dc None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.165093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:25.170275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.170980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.171524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.171524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.172171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.173526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.216134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb6ee5-2af0-423d-89dc-35c5a85948c2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.249229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.249850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.250129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.250404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.258427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.259906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:25.271840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:25.272873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 401/814] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:25.273802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.294971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 414/815] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:25 2022] POST /identity/v3/endpoints => generated 346 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:25.295990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.391083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:25.406334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a72cbd-ad60-496c-8b43-5e79a5d5f085 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.421924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:25.452627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791fed3-09dc-4356-a887-4da19a1b58d5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.453479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.454118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.454399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.454673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] PATH_INFO: `/v3/services/network` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.455296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.456666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:25.467964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:25.468996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:25.469835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 402/816] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/services/network => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:25.470625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.504257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.504937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.505572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.505572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.506247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:25.506557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.509921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.534989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 415/817] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:25.535825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.605900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2287bd59-8fc5-4b7e-9cd3-ece74fd2c5aa None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.644723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.645341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.645629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.645907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.646661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:25.647015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.648472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.677887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 403/818] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:25.679051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.679615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d2eb97-3730-451f-89a3-9652a4062b4b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.695586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:25.714112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:25.723690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.724625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.725115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.725594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.727158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] RBAC: Adding query filter params (name=network) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:25.727693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.729693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.743810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 416/819] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:25.745158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.813531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f29e22-1ca1-48e9-ab80-a6507232cd2a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.861533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae2f82c-f792-4a7b-be80-947615141924 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:25.866782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60691c52-6cef-4f57-8877-740944679519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.867583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691c52-6cef-4f57-8877-740944679519 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.868017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691c52-6cef-4f57-8877-740944679519 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.868470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60691c52-6cef-4f57-8877-740944679519 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.899653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:25.900061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:25.900442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:25.900813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:25.912745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.914257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:25.934839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:25.936128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:25.937315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:25.937315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:25.937315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:25.939797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 417/820] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:25.940822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:25.965392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60691c52-6cef-4f57-8877-740944679519 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:25.969916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60691c52-6cef-4f57-8877-740944679519 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:25.984504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.011125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.064311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa19635-f99a-4592-aad8-e93a1d9a1d1f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.102541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:26.103442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.103701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.103979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.104723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] RBAC: Adding query filter params (type=network) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:26.105168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:26.106513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:26.108605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 404/821] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:26.109678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60691c52-6cef-4f57-8877-740944679519 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.117763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 418/822] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:25 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:26.118662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.238379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.239041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60691c52-6cef-4f57-8877-740944679519 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.249715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae2221-1a25-47da-a4ed-504c4dc342be None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.267711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.272627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:26.273243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.273527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.273800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.274605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:26.274978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:26.276366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:26.285702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7e459e-610f-4bdd-8667-2a843b32eabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:26.286597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e459e-610f-4bdd-8667-2a843b32eabf None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.287145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e459e-610f-4bdd-8667-2a843b32eabf None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.287617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7e459e-610f-4bdd-8667-2a843b32eabf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.288151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 405/823] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:26.288935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.303095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e459e-610f-4bdd-8667-2a843b32eabf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:26.304889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7e459e-610f-4bdd-8667-2a843b32eabf None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-4f7e459e-610f-4bdd-8667-2a843b32eabf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:26.320569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:26.321814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:26.322980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:26.322980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:26.322980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:26.322980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 419/824] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:26.324122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec788-1c3f-4012-bae7-5aab4ba8336e None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.324402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec788-1c3f-4012-bae7-5aab4ba8336e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.324799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caec788-1c3f-4012-bae7-5aab4ba8336e None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.330903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 420/825] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:26.330903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec788-1c3f-4012-bae7-5aab4ba8336e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.400466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228302f7-0501-4301-a937-2c63db54f558 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.435981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:26.436591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.436875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.437157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.437823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:26.439237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:26.450285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caec788-1c3f-4012-bae7-5aab4ba8336e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.484680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491901d-484b-47c5-b3d0-e7325c818515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:26.485315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491901d-484b-47c5-b3d0-e7325c818515 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.485597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491901d-484b-47c5-b3d0-e7325c818515 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.485872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491901d-484b-47c5-b3d0-e7325c818515 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.492667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491901d-484b-47c5-b3d0-e7325c818515 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:26.494055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491901d-484b-47c5-b3d0-e7325c818515 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-c491901d-484b-47c5-b3d0-e7325c818515 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:26.505849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:26.507521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 421/826] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:26.508406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f3ea-22b9-4579-8cbe-e434237d94dd None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.509059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f3ea-22b9-4579-8cbe-e434237d94dd None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.509059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab4f3ea-22b9-4579-8cbe-e434237d94dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.516657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.527882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3ab4f3ea-22b9-4579-8cbe-e434237d94dd None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:26.529093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3ab4f3ea-22b9-4579-8cbe-e434237d94dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:26.555062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 406/827] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:26 2022] POST /identity/v3/endpoints => generated 337 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:26.555062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.630004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 422/828] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:26.631050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4f3ea-22b9-4579-8cbe-e434237d94dd None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.637209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.736508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2007b475-0e6f-4af7-b520-f1111cb8ffff None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.792419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:26.792419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.793313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.793552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.794222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:26.794527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:26.795981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:26.809266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 407/829] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:26.811074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab4f3ea-22b9-4579-8cbe-e434237d94dd None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.814965 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.848107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:26.856122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:26.856744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:26.857025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:26.857299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:26.858010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:26.858311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:26.859898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:26.874884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 423/830] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:26.882287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:26.966979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8fabd-1766-4c9a-aa8a-a033f94efc7c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:26.979059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:27.005823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.006458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.006744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.007053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.008832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfbcd2-ee0d-435d-b859-af96c83b8b81 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.014876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.016698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:27.028896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:27.029815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 408/831] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:27.031514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.051052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.051649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.051935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.052220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/59375961363e484ca6607126bbf0741b/roles/88decb556961404a9be5356f86b742f1` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.068203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=59375961363e484ca6607126bbf0741b, role_id=88decb556961404a9be5356f86b742f1)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.069655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.137361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e92250-8214-491f-8103-34aaa13a1427 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.173383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.174021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.174321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.174581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.185291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:27.190023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:27.192107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 409/832] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:27.193264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.196303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 424/833] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:26 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/59375961363e484ca6607126bbf0741b/roles/88decb556961404a9be5356f86b742f1 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:38:27.202560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.233654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:27.268649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:27.337186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486e16c2-9c49-4a7d-8b7c-c8596a730d6b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.348052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c55e1aa-3d38-4d52-a70b-be5aa919013c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.382201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.382865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.383273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.383487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.384208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:27.384519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.385972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.387658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.388401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.388780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.389146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.389920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:27.390323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.398185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.403572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 425/834] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:27.407142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 410/835] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:27.408899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.412894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.514294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46a5102-e060-4734-9616-c2a05da063c0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.514882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:27.517534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:27.527553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556e80b5-4e8b-4117-9363-7c90ddcf05a9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.549772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.550421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.550702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.551009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.561778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.563317 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3d81da-e404-4d0b-b7fd-3bfbfa09062b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.563474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.564035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d81da-e404-4d0b-b7fd-3bfbfa09062b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.564380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d81da-e404-4d0b-b7fd-3bfbfa09062b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.564713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3d81da-e404-4d0b-b7fd-3bfbfa09062b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.565507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d81da-e404-4d0b-b7fd-3bfbfa09062b None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=2a68d368b5d14b75aaba3bbb3f4bb62c) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:27.565886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d81da-e404-4d0b-b7fd-3bfbfa09062b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.567391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3d81da-e404-4d0b-b7fd-3bfbfa09062b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.579187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 411/836] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/role_assignments?user.id=2a68d368b5d14b75aaba3bbb3f4bb62c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:27.579817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:27.580938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:27.582049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:27.582049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:27.582049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:27.583062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad018a-8edc-4ad4-8409-34a2a330552d None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.583458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad018a-8edc-4ad4-8409-34a2a330552d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.584006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bad018a-8edc-4ad4-8409-34a2a330552d None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.584376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 426/837] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:27.588775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 412/838] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:27.590477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.594561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ac26-f698-499b-a905-2bf5b97aebb3 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.595011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ac26-f698-499b-a905-2bf5b97aebb3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.595393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e325ac26-f698-499b-a905-2bf5b97aebb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.618727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e325ac26-f698-499b-a905-2bf5b97aebb3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:27.620257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e325ac26-f698-499b-a905-2bf5b97aebb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:27.705582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7299146c-b442-47e7-8699-09adfd9412ff None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.715196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 413/839] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:27.751796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.752415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.752740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.753023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.753682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:27.753998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.755416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.771018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 427/840] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:27.776784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325ac26-f698-499b-a905-2bf5b97aebb3 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.869274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:27.888378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e325ac26-f698-499b-a905-2bf5b97aebb3 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:27.925773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:27.926420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:27.926707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:27.927042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] PATH_INFO: `/v3/users/swift` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:27.935422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:27.936899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:27.950533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:27.951572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:27.952507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 414/841] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:27.957995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:27.977264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:28.007823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:28.075518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac1d23e-dfda-4716-8e4a-cbd5d359ee3e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:28.111842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c428760-76e1-4827-b065-63501bad029a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:28.112468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c428760-76e1-4827-b065-63501bad029a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:28.112754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c428760-76e1-4827-b065-63501bad029a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:28.113031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c428760-76e1-4827-b065-63501bad029a None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:28.113775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c428760-76e1-4827-b065-63501bad029a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:28.114085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c428760-76e1-4827-b065-63501bad029a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:28.115561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c428760-76e1-4827-b065-63501bad029a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:28.140718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 428/842] 10.222.0.59 () {56 vars in 1135 bytes} [Wed Aug 24 06:38:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:28.141577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c428760-76e1-4827-b065-63501bad029a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:28.149419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c0e766-ec79-4d8f-8c1b-9be09abc4fad None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:28.185270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:28.185910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:28.186193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:28.186468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:28.187105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:28.188476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:28.197580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:28.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:28.199496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 415/843] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:28 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:28.206696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:28.218027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:28.247167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:28.257857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c428760-76e1-4827-b065-63501bad029a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:28.305076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:28.305718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:28.305965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:28.306254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:28.331095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e05e72-6fcd-4cbe-a564-e421d3646ac7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:28.369298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:28.370217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:28.371243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:28.371713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:28.372583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:28.373065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:28.374657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:28.380182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 416/844] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:28 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:28.385304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:28.400297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:28.401688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:28.484958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:28.489450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:28.522514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b089d11-5ae6-4e3f-9526-42e2608e0d0b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:28.522811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 429/845] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:28.529302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:28.575751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:28.576637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:28.577149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:28.577783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:28.578593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:28.579684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:28.581632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:28.588809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 417/846] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:28 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:28.658885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd35ed6a-239c-4830-900c-b5ade9c8d6b2 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:28.700811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:28.701463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:28.701747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:28.702028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:28.715146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:28.716664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:28.733667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:28.734672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:28.735594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:28.735594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:28.735594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:28.735594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 430/847] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:28.741024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:28.848692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92bd2f-e458-4b19-ab39-59668df765e8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:28.890563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:28.891224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:28.891506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:28.891782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:28.892445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:28.892746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:28.894137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:28.906884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:28.907169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 418/848] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:28.912345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:28.941030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:29.022400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6410a1c-5b70-4459-a8cc-720ca9160fa7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:29.059468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a628a1af-881f-43e9-aee5-4fd5702f11f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:29.060353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a1af-881f-43e9-aee5-4fd5702f11f6 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.060788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a1af-881f-43e9-aee5-4fd5702f11f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.061213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a628a1af-881f-43e9-aee5-4fd5702f11f6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.068503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a1af-881f-43e9-aee5-4fd5702f11f6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:29.070174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a628a1af-881f-43e9-aee5-4fd5702f11f6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-a628a1af-881f-43e9-aee5-4fd5702f11f6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:29.083013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:29.084112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:29.085215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:29.087306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 431/849] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:29.093830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:29.182119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c073b-3573-4558-a427-f2319e111818 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.182347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c073b-3573-4558-a427-f2319e111818 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.182702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675c073b-3573-4558-a427-f2319e111818 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.184436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 432/850] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:29.189752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843e5f-525a-42d0-ac84-bf3efac0bbc1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.190041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843e5f-525a-42d0-ac84-bf3efac0bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.190320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5843e5f-525a-42d0-ac84-bf3efac0bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.206530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3584d6-c2ce-434c-bada-c1dc542a5943 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:29.209480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c5843e5f-525a-42d0-ac84-bf3efac0bbc1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:29.210710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c5843e5f-525a-42d0-ac84-bf3efac0bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:29.242490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:29.243145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.243429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.243708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.244422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:29.244732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:29.246364 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:29.258948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 419/851] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:29.267505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:29.293440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 433/852] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:29.333809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:29.384582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6c3a7a-1a10-458a-936b-80948c351a75 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:29.423050 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:29.423666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.423949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.424248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.424985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=c1dfd6a8d9194f7a949a77207931eb15) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:29.425352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:29.426791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:29.433249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 420/853] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:29 2022] GET /identity/v3/role_assignments?user.id=c1dfd6a8d9194f7a949a77207931eb15&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:29.564693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843e5f-525a-42d0-ac84-bf3efac0bbc1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:29.581676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:29.675547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5843e5f-525a-42d0-ac84-bf3efac0bbc1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:29.716391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9599f-5a2a-4454-b6bb-18e7524c1d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:29.717094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9599f-5a2a-4454-b6bb-18e7524c1d35 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.717381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9599f-5a2a-4454-b6bb-18e7524c1d35 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.717657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9599f-5a2a-4454-b6bb-18e7524c1d35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.729357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9599f-5a2a-4454-b6bb-18e7524c1d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-e6d9599f-5a2a-4454-b6bb-18e7524c1d35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:29.734362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:29.735455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:29.736542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 434/854] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:38:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:29.743574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:29.778670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c662f-1bb5-4d78-9a6f-ccd8ea87c72e None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.779026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c662f-1bb5-4d78-9a6f-ccd8ea87c72e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.779293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c662f-1bb5-4d78-9a6f-ccd8ea87c72e None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.782816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 435/855] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:29.785973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ed6a-7343-4929-9ea6-8709842d7f3f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.786259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ed6a-7343-4929-9ea6-8709842d7f3f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.786534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c848ed6a-7343-4929-9ea6-8709842d7f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.809598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c848ed6a-7343-4929-9ea6-8709842d7f3f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:29.810839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c848ed6a-7343-4929-9ea6-8709842d7f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:29.872167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61febf14-f36f-47ae-a1b7-6658443d91be None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:29.885589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 436/856] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:29.895492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:29.913195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:29.914158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:29.914681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:29.915207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:29.916338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:29.916890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:29.919011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:29.928589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 421/857] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:38:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:29.934604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848ed6a-7343-4929-9ea6-8709842d7f3f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:29.938236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:30.048873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c848ed6a-7343-4929-9ea6-8709842d7f3f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.084938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.085580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.085911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.086230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.097383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.098880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:30.114020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:30.115032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:30.115986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:30.115986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:30.115986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:30.115986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 437/858] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:30.121091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:30.196651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:30.232830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32594370-ddce-45f5-b236-96e1925ef698 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.262162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:30.272198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.273121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.273561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.273992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.278576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:30.278576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.278576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:30.289803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 422/859] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:30.297043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:30.340296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc4aa7-5bec-486c-a85d-690b2ff92bb9 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.374943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:30.386014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.386923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.387458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.387835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.388763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.390175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:30.399746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:30.400979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:30.402470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:30.408255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 438/860] 10.222.0.59 () {56 vars in 1132 bytes} [Wed Aug 24 06:38:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:30.411514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:30.462273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b3e7c-c358-469c-8d43-2daac0e21a7b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.499586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.500234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.500535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.500860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.509694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.511442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:30.523900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:30.524899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:30.525929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:30.530426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 423/861] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:38:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:30.531527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:30.547543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f68ad7-8390-4d60-b2ae-0f00c9d5e848 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.570297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:30.586696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.587833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.588312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.588823 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.590205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:30.590882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.592574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:30.602824 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 439/862] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:30.603980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:30.638308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:30.642915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634623ab-c332-45f2-98a9-63207591c74d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.681258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10435b2-2ac9-4d1a-a681-510b121238fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.681973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10435b2-2ac9-4d1a-a681-510b121238fd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.682255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10435b2-2ac9-4d1a-a681-510b121238fd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.682534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10435b2-2ac9-4d1a-a681-510b121238fd None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.683350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10435b2-2ac9-4d1a-a681-510b121238fd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:30.683662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10435b2-2ac9-4d1a-a681-510b121238fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.685116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10435b2-2ac9-4d1a-a681-510b121238fd None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:30.714813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 424/863] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 06:38:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:30.714813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776bef-24f7-4f6b-b4e0-2570804c99af None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.714813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776bef-24f7-4f6b-b4e0-2570804c99af None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.714813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d776bef-24f7-4f6b-b4e0-2570804c99af None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.714813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 425/864] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:30.718350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d776bef-24f7-4f6b-b4e0-2570804c99af None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:30.726961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40372377-823f-44cc-8fdf-129cee6c936a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.764414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f651ac-730c-43fb-b5e4-7f46ed0ce9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.765287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f651ac-730c-43fb-b5e4-7f46ed0ce9b2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.765630 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f651ac-730c-43fb-b5e4-7f46ed0ce9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.765987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f651ac-730c-43fb-b5e4-7f46ed0ce9b2 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.766859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f651ac-730c-43fb-b5e4-7f46ed0ce9b2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:30.767165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f651ac-730c-43fb-b5e4-7f46ed0ce9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.769284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f651ac-730c-43fb-b5e4-7f46ed0ce9b2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:30.775348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 440/865] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:30.777199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebeca-03e6-4b72-9c4d-ebcd330ba742 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.777507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebeca-03e6-4b72-9c4d-ebcd330ba742 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.777781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2ebeca-03e6-4b72-9c4d-ebcd330ba742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.797114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-7c2ebeca-03e6-4b72-9c4d-ebcd330ba742 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:30.798356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7c2ebeca-03e6-4b72-9c4d-ebcd330ba742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:30.853414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:30.859356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d776bef-24f7-4f6b-b4e0-2570804c99af None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:30.888778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 441/866] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:30.909633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:30.910716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:30.911258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:30.911731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:30.947644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:30.997402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:30.998890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:31.103020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 426/867] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:30 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:31.108751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebeca-03e6-4b72-9c4d-ebcd330ba742 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:31.163334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:31.231275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2ebeca-03e6-4b72-9c4d-ebcd330ba742 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:31.243115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:31.284669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:31.285321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:31.285605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:31.285885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:31.294178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548369e-1e10-44ab-b395-16af0439bc85 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:31.304421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:31.306292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:31.323311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:31.324860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:31.325747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:31.325747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:31.325747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:31.327746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 442/868] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:31.333271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:31.340124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879cf3f6-0169-429a-93f9-5d78efd13b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:31.340757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf3f6-0169-429a-93f9-5d78efd13b0b None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:31.341042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf3f6-0169-429a-93f9-5d78efd13b0b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:31.341319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879cf3f6-0169-429a-93f9-5d78efd13b0b None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:31.342067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf3f6-0169-429a-93f9-5d78efd13b0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:31.343648 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879cf3f6-0169-429a-93f9-5d78efd13b0b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:31.371463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:31.430000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 427/869] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:31 2022] POST /identity/v3/services => generated 251 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:31.464371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4889171-af90-4b94-99db-451430f7d551 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:31.499751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9db28-04c5-4f94-97d4-943fed36e2cf None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:31.500191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9db28-04c5-4f94-97d4-943fed36e2cf None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:31.500579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9db28-04c5-4f94-97d4-943fed36e2cf None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:31.502696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 428/870] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:31.512882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a164e59-cffc-4bd0-b0c1-8e581b710b42 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:31.513303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:31.513437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a164e59-cffc-4bd0-b0c1-8e581b710b42 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:31.513765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a164e59-cffc-4bd0-b0c1-8e581b710b42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:31.514360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:31.514808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:31.515219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:31.516031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:31.516497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:31.518041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:31.531380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 443/871] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:31.536100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7a164e59-cffc-4bd0-b0c1-8e581b710b42 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:31.536776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7a164e59-cffc-4bd0-b0c1-8e581b710b42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:31.537527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:31.615719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 429/872] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:31 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:31.643412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:31.656176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62310c1a-923f-419c-a783-3f527263f781 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:31.694946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:31.695595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:31.695868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:31.696141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:31.709227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:31.710690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:31.723959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:31.724868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:31.725792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 444/873] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:31.735794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a164e59-cffc-4bd0-b0c1-8e581b710b42 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:31.789979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:31.847731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a164e59-cffc-4bd0-b0c1-8e581b710b42 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:31.884310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:31.884956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:31.885186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:31.885465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:31.886207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:31.886514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:31.888147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:31.901286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 430/874] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:31.908082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:31.908701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:32.039690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a59249-678f-4489-9dac-511e8afc8667 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:32.048882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c81ebe-25f2-4002-b0a4-1a335540ef5f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:32.062277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:32.087905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:32.088531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:32.089703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:32.089963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:32.090902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=59375961363e484ca6607126bbf0741b) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:32.091361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:32.092960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:32.097583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:32.098520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:32.098999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:32.099429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:32.099719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 445/875] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:31 2022] GET /identity/v3/role_assignments?user.id=59375961363e484ca6607126bbf0741b&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:32.100476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:32.101874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:32.115549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:32.116623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:32.117464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 431/876] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:32.123244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:32.141894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:32.244184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52298493-a8ee-4b60-ad44-93f4ec9c35c5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:32.279945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa806961-1629-48ab-a997-4f584e42d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:32.280560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa806961-1629-48ab-a997-4f584e42d533 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:32.280842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa806961-1629-48ab-a997-4f584e42d533 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:32.281142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa806961-1629-48ab-a997-4f584e42d533 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:32.281782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa806961-1629-48ab-a997-4f584e42d533 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:32.282086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa806961-1629-48ab-a997-4f584e42d533 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:32.283489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa806961-1629-48ab-a997-4f584e42d533 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:32.288447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 446/877] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:32.294498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:32.405734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb28875-8d73-4d3f-ad2b-a37afb27ccd9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:32.445096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0bd60-d68c-4470-aafc-497a2f589ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:32.446012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0bd60-d68c-4470-aafc-497a2f589ca8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:32.446504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0bd60-d68c-4470-aafc-497a2f589ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:32.447006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0bd60-d68c-4470-aafc-497a2f589ca8 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:32.447820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0bd60-d68c-4470-aafc-497a2f589ca8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:32.448914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0bd60-d68c-4470-aafc-497a2f589ca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:32.450667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0bd60-d68c-4470-aafc-497a2f589ca8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:32.456810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 432/878] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:32.901526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dd93-01d0-4baa-af14-103ee091de63 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:32.902042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dd93-01d0-4baa-af14-103ee091de63 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:32.902146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5357dd93-01d0-4baa-af14-103ee091de63 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:32.903761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 447/879] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:32.909411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62f61-485e-4ae1-93e3-653a06fc1880 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:32.909905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62f61-485e-4ae1-93e3-653a06fc1880 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:32.909982 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf62f61-485e-4ae1-93e3-653a06fc1880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:32.930168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-faf62f61-485e-4ae1-93e3-653a06fc1880 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:32.931776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-faf62f61-485e-4ae1-93e3-653a06fc1880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:32.963281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:33.004049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 433/880] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:33.271691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357dd93-01d0-4baa-af14-103ee091de63 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:33.358383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:33.389802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5357dd93-01d0-4baa-af14-103ee091de63 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:33.425147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:33.425761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:33.426042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:33.426316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:33.426997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:33.428374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:33.455362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e949-4570-4b20-80d7-f454b9a9e5e0 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:33.455650 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e949-4570-4b20-80d7-f454b9a9e5e0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:33.455928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef8e949-4570-4b20-80d7-f454b9a9e5e0 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:33.457437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 434/881] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:33.462303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d397-43d3-4c20-8418-3ff9408eb4c9 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:33.462593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d397-43d3-4c20-8418-3ff9408eb4c9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:33.462974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4250d397-43d3-4c20-8418-3ff9408eb4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:33.481765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-4250d397-43d3-4c20-8418-3ff9408eb4c9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:33.482995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4250d397-43d3-4c20-8418-3ff9408eb4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:33.526179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 448/882] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:33 2022] POST /identity/v3/services => generated 269 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:33.571619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 435/883] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:33.854242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:33.967108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae2fc4-2db6-45d2-8b14-d6e513696173 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:34.004971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:34.005627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.005910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.006203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.006839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:34.008249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:34.010574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:34.018334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:34.019412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:34.020276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 449/884] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:34.027931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d397-43d3-4c20-8418-3ff9408eb4c9 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:34.131485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:34.140192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4250d397-43d3-4c20-8418-3ff9408eb4c9 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:34.176968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8cbccd-3fec-4b9a-92fc-57e1fe4b1e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:34.177589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cbccd-3fec-4b9a-92fc-57e1fe4b1e6d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.177911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cbccd-3fec-4b9a-92fc-57e1fe4b1e6d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.178190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8cbccd-3fec-4b9a-92fc-57e1fe4b1e6d None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.178851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cbccd-3fec-4b9a-92fc-57e1fe4b1e6d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:34.179162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cbccd-3fec-4b9a-92fc-57e1fe4b1e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:34.180529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8cbccd-3fec-4b9a-92fc-57e1fe4b1e6d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:34.185659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 436/885] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:34 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:34.191085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:34.245954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0722c3f-897b-46a3-bb42-3c0f6616b7f0 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.246266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0722c3f-897b-46a3-bb42-3c0f6616b7f0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.246523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0722c3f-897b-46a3-bb42-3c0f6616b7f0 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.247937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 437/886] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:34.253139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca438c4-06a3-47d7-bb93-a890a7104d36 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.253468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca438c4-06a3-47d7-bb93-a890a7104d36 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.253753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca438c4-06a3-47d7-bb93-a890a7104d36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.272838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-4ca438c4-06a3-47d7-bb93-a890a7104d36 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:34.274158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4ca438c4-06a3-47d7-bb93-a890a7104d36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:34.297569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fc225-61d2-4459-8ff8-9b3188eadd87 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:34.332971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:34.333583 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.333861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.334135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.334783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:34.335190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:34.336710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:34.343008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 450/887] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:34 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:34.348712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:34.350475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 438/888] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:34.419063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:34.465476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43876918-7b95-4a8b-855f-9bfd4733acc3 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:34.501582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:34.502220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.502503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.502793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.503512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] RBAC: Adding query filter params (interface=public, service_id=9b974032cc8749f6bdf020c7312f2c6d, region_id=RegionOne) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:34.503820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:34.505200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:34.512017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 451/889] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:38:34 2022] GET /identity/v3/endpoints?service_id=9b974032cc8749f6bdf020c7312f2c6d&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:34.516569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3ab87-30ce-4e20-88b2-37708cc9e888 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.517002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3ab87-30ce-4e20-88b2-37708cc9e888 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.517379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb3ab87-30ce-4e20-88b2-37708cc9e888 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.518016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:34.519381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 439/890] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:34.526910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505505-5d42-4c18-9389-fd1a6704931f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.526910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505505-5d42-4c18-9389-fd1a6704931f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.526910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37505505-5d42-4c18-9389-fd1a6704931f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.552952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-37505505-5d42-4c18-9389-fd1a6704931f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:34.554555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-37505505-5d42-4c18-9389-fd1a6704931f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:34.641764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15268e32-44a4-40d9-b2d7-48bc495b7742 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:34.648094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 440/891] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:34.649085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505505-5d42-4c18-9389-fd1a6704931f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:34.673470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:34.678319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:34.682789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:34.684015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.684727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.685456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.686673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:34.689212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:34.701204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 452/892] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:34 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:38:34.785177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37505505-5d42-4c18-9389-fd1a6704931f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:34.824938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:34.825630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:34.825915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:34.826191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:34.838168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:34.843111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:34.844179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:34.845077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 441/893] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 06:38:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:34.852352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:34.934679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:34.969959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ddfb6-57f0-4fca-9a20-a0100e019c6d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:35.016764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:35.017966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:35.018933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.019224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.019501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.020456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:35.020764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:35.022687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:35.032289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 453/894] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 06:38:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:35.037809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:35.044367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2716637-e4d8-4382-8aec-d6b25965232b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:35.082229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:35.083307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.083859 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.084340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.085227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:35.086859 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:35.104353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:35.154265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86977e0d-0325-4c79-8ae7-cd64174f5721 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:35.190873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 442/895] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:34 2022] POST /identity/v3/services => generated 241 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:35.210416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:35.211523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.212225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.212726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.227038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:35.229025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:35.247423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:35.248476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:35.249394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:35.249394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:35.249394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:35.251875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 454/896] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:35.258497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:35.387593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec74de1-9db3-4b26-a3b4-62a41203ce18 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:35.422668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee298568-5299-40c4-8b01-529ee9325a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:35.423320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298568-5299-40c4-8b01-529ee9325a5d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.427888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298568-5299-40c4-8b01-529ee9325a5d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.428197 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee298568-5299-40c4-8b01-529ee9325a5d None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.428891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298568-5299-40c4-8b01-529ee9325a5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:35.429206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298568-5299-40c4-8b01-529ee9325a5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:35.430600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee298568-5299-40c4-8b01-529ee9325a5d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:35.433957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:35.445189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 443/897] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:35.450970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:35.560983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:35.567412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d6e26e-721e-4767-bfef-7723cbc438ec None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:35.597723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c61a-3a1b-4d6d-b05b-1ccb49c6a6a1 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.598083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c61a-3a1b-4d6d-b05b-1ccb49c6a6a1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.598284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a1c61a-3a1b-4d6d-b05b-1ccb49c6a6a1 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.599839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 444/898] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:35.606163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdd892-aee5-4402-b342-75c5113d633c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.606791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdd892-aee5-4402-b342-75c5113d633c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.607291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bdd892-aee5-4402-b342-75c5113d633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.611047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:35.611679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.611971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.612251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.620200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:35.621679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:35.627771 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-30bdd892-aee5-4402-b342-75c5113d633c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:35.629311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-30bdd892-aee5-4402-b342-75c5113d633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:35.635559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:35.636562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:35.637512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 455/899] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:38:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:35.643362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:35.730029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 445/900] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:35.772268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0651355-048f-40e6-bead-b220a69d04e7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:35.809932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:35.813662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:35.813662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:35.813662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:35.813662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:35.813662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:35.815111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:35.836366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 456/901] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 06:38:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:35.842989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdd892-aee5-4402-b342-75c5113d633c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:35.959689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bdd892-aee5-4402-b342-75c5113d633c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:35.988649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:35.998858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.007731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.007731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.007731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.007994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.028216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:36.090997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.093530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.143954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b2dc88-603f-4a18-9bc6-959950ac7030 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:36.188755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.189488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.189911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.190209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.190935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.192589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:36.206585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:36.207682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:36.208577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:36.219596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 457/903] 10.222.0.59 () {56 vars in 1132 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:36.219919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 446/903] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:36.220209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.221217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.258320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:36.318116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:36.343182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d277ae-3706-4092-864a-b439a4035f4e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:36.353993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048d25ef-6427-47ae-b302-e8b29b07f869 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:36.391790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.393003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.393603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.394079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.394993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:36.395495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.397944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.405402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 458/904] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:36.414505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.419034 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.421329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.421329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.421329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.442183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.445121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:36.477181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:36.478199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:36.479118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:36.479118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:36.479118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:36.486665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 447/905] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:36.488279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.576757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af7b85-9f49-478b-afcf-7227fae44783 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:36.592221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:36.618403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7644d439-949a-4165-bae1-d0f5c448433b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:36.640273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.641932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.642667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.644192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.645936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:36.646689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.650702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.660328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.661091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.661475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.661852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.662608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:36.663130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.671351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.671598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 459/906] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:36.679927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.693144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 448/907] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:36.694500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:36.695887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.804214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1023a3db-e8fb-4e95-b913-eef9fb689e49 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:36.809063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4fc20a-b7b1-4e22-ac89-185c72ab79bf None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:36.849168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.849488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:36.850052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.850335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.850611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.851022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:36.851359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] RBAC: Adding query filter params (interface=public, service_id=8f08c3c0572145d9b4d55fd9a47d01cc, region_id=RegionOne) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:36.851671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.851919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:36.852381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:36.853133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.864420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 460/908] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/endpoints?service_id=8f08c3c0572145d9b4d55fd9a47d01cc&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:36.865413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.866074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:36.867779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:36.870670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:36.881956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:36.883482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:36.884405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:36.886324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 449/909] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:36.892324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:36.951050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:36.984795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4f68d9-ea3f-41db-adf3-24798cb6a2b6 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:37.011761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4566c10c-882d-4d18-bfd8-09a1c1f5a862 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:37.021967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2233cdbb-27f6-420c-9dcc-02aabefdd8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:37.022661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233cdbb-27f6-420c-9dcc-02aabefdd8a2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.023032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233cdbb-27f6-420c-9dcc-02aabefdd8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.023309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2233cdbb-27f6-420c-9dcc-02aabefdd8a2 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.023951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233cdbb-27f6-420c-9dcc-02aabefdd8a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:37.025491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2233cdbb-27f6-420c-9dcc-02aabefdd8a2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:37.034957 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 461/910] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/services => generated 1497 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:38:37.036532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8093-73cf-477c-96c0-7157d5868fdf None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.036838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8093-73cf-477c-96c0-7157d5868fdf None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.037087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20a8093-73cf-477c-96c0-7157d5868fdf None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.042940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 462/911] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:37.045526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf14d9-9682-4d2c-84de-23a0e16407e5 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.045807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf14d9-9682-4d2c-84de-23a0e16407e5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.046085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf14d9-9682-4d2c-84de-23a0e16407e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.067577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:37.068354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.069441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.069741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.070464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:37.070793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:37.074298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:37.080966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9bcf14d9-9682-4d2c-84de-23a0e16407e5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:37.083696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9bcf14d9-9682-4d2c-84de-23a0e16407e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:37.089062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 450/912] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:37.094945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:37.159404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:37.211221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 463/913] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:37.216280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcaba75-7c7b-4670-bd6c-042ceb62a8a4 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:37.256178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:37.256796 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.257072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.257345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.258133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] RBAC: Adding query filter params (role.id=d9d7e56793ab4546a30f2273fa612371, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=59375961363e484ca6607126bbf0741b) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:37.258451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:37.259899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981335ed-2506-4ea3-baf6-fba7b89e5b6b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.260046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:37.260220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981335ed-2506-4ea3-baf6-fba7b89e5b6b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.260509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981335ed-2506-4ea3-baf6-fba7b89e5b6b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.262217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 464/914] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:37.266860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 451/915] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:37 2022] GET /identity/v3/role_assignments?user.id=59375961363e484ca6607126bbf0741b&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=d9d7e56793ab4546a30f2273fa612371 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:37.267378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb141a-6e2e-4cd4-9819-513563001a54 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.267673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb141a-6e2e-4cd4-9819-513563001a54 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.268014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb141a-6e2e-4cd4-9819-513563001a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.294202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-fbfb141a-6e2e-4cd4-9819-513563001a54 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:37.295843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fbfb141a-6e2e-4cd4-9819-513563001a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:37.380639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:37.387228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 465/916] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:37.487519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:37.598681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3560eb-c07d-499f-b99d-fff63e019a67 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:37.626559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:37.640504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:37.641644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.642135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.642635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.643476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:37.645162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:37.655738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:37.656790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 24 06:38:37.657630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:37.660676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 452/917] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:37.667271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb141a-6e2e-4cd4-9819-513563001a54 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:37.667818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:37.818576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062802ec-1f03-40c9-800a-8eb49a873fb1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:37.853050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb141a-6e2e-4cd4-9819-513563001a54 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:37.868026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:37.870430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.871452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.872869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.874667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:37.875712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:37.879078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:37.895806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:37.896594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:37.897099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:37.897483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:37.898233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:37.899975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:37.909520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:37.910519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:37.911720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:37.915635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 466/918] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:37.916835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:37.917529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 453/919] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:37 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:37.923015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:37.979041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:38.001656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:38.048096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00754bed-76fd-48f1-8d17-8e932774c779 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:38.058355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822a91bb-ff97-48a2-8cb1-3f54c83c48e0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:38.091890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:38.092666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:38.093134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:38.093502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:38.094421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:38.094842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:38.096606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:38.096868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:38.098283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:38.098874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:38.099287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:38.100205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:38.100690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:38.102252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:38.102966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 467/920] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:38.107789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:38.117197 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 454/921] 10.222.0.59 () {56 vars in 1114 bytes} [Wed Aug 24 06:38:37 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:38.118469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:38.251839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da44b3-5850-4f2a-969d-18977790a2c0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:38.264640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a07b4-2746-4bc2-b645-077ccd0555f6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:38.282868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:38.288891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:38.303061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:38.304025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:38.308462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:38.308462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:38.308462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:38.308462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:38.308775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:38.308881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:38.308963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:38.308963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:38.308963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:38.309493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:38.310689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:38.320608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 468/922] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:38.322386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:38.433579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d57e57-4620-45a7-81f4-7b6f6274dd23 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:38.451098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 455/923] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:38.497421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daed93b4-796c-4d40-aa5e-52f697fe9f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:38.498055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed93b4-796c-4d40-aa5e-52f697fe9f9d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:38.498333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed93b4-796c-4d40-aa5e-52f697fe9f9d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:38.498608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daed93b4-796c-4d40-aa5e-52f697fe9f9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:38.499373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed93b4-796c-4d40-aa5e-52f697fe9f9d None admin] RBAC: Adding query filter params (interface=public, service_id=4290707960194b48a11a74ecea0678ed, region_id=RegionOne) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:38.499687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed93b4-796c-4d40-aa5e-52f697fe9f9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:38.501292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daed93b4-796c-4d40-aa5e-52f697fe9f9d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:38.507994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 469/924] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:38:38 2022] GET /identity/v3/endpoints?service_id=4290707960194b48a11a74ecea0678ed&interface=public®ion_id=RegionOne => generated 194 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:38.513972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:38.665474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037b3b0e-a24a-4667-b541-420a693c6c40 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:38.706708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4b0ffe-310a-4f49-9967-effc09fca7ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:38.707327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0ffe-310a-4f49-9967-effc09fca7ea None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:38.707608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0ffe-310a-4f49-9967-effc09fca7ea None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:38.707879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4b0ffe-310a-4f49-9967-effc09fca7ea None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:38.708493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b0ffe-310a-4f49-9967-effc09fca7ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:38.709867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4b0ffe-310a-4f49-9967-effc09fca7ea None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:38.717486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 456/925] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:38 2022] GET /identity/v3/services => generated 1497 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:38:39.216636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75423-781f-4a23-b092-9d7963ebdf3b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:39.217212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75423-781f-4a23-b092-9d7963ebdf3b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:39.217212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac75423-781f-4a23-b092-9d7963ebdf3b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:39.218829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 470/926] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:39.224344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab490e0-c32d-41fd-a890-7dd31ef98f45 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:39.224847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab490e0-c32d-41fd-a890-7dd31ef98f45 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:39.224937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab490e0-c32d-41fd-a890-7dd31ef98f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:39.243374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-cab490e0-c32d-41fd-a890-7dd31ef98f45 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:39.244628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cab490e0-c32d-41fd-a890-7dd31ef98f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:39.262276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c288bb-f6f3-4661-96e8-c1df6d3bb909 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:39.262709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c288bb-f6f3-4661-96e8-c1df6d3bb909 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:39.263222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c288bb-f6f3-4661-96e8-c1df6d3bb909 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:39.266152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 471/927] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:39.273892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2bcf5-8ebb-445d-b233-3c754852be74 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:39.274357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2bcf5-8ebb-445d-b233-3c754852be74 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:39.274643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2bcf5-8ebb-445d-b233-3c754852be74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:39.277355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:39.296975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f2c2bcf5-8ebb-445d-b233-3c754852be74 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:39.298626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f2c2bcf5-8ebb-445d-b233-3c754852be74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:39.340635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 457/928] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:39.371150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:39.387468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 472/929] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:39.618179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab490e0-c32d-41fd-a890-7dd31ef98f45 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:39.676096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2bcf5-8ebb-445d-b233-3c754852be74 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:39.750160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab490e0-c32d-41fd-a890-7dd31ef98f45 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:39.795607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:39.796652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:39.797049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:39.797405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:39.798557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:39.800370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:39.806743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2bcf5-8ebb-445d-b233-3c754852be74 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:39.812892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:39.820242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:39.821444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 458/930] 10.222.0.59 () {56 vars in 1132 bytes} [Wed Aug 24 06:38:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:39.828017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:39.855374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:39.856174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:39.856555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:39.856922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:39.869260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:39.874986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:39.877164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:39.879132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:39.882879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 473/931] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 06:38:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:39.883773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:39.904999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:39.977626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:39.991201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8599542-96b3-46b4-a0d2-3c532d0f119d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.036187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.036839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.037214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.037589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.038479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:40.038861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.040349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.051859 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 459/932] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:40.053892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:40.071793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bd88c4-f09a-4718-8d6b-e38cabc406be None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.118447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.120066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.120771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.121204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.122337 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:40.122853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.124906 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.138300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 474/933] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 06:38:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:40.144101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:40.182622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:40.193837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d1e20d-3b50-43e9-8f2f-c0e098d998bc None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.242470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78768b81-0876-499a-9110-905a64261216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.243162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78768b81-0876-499a-9110-905a64261216 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.243162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78768b81-0876-499a-9110-905a64261216 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.243303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78768b81-0876-499a-9110-905a64261216 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.243971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78768b81-0876-499a-9110-905a64261216 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:40.244279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78768b81-0876-499a-9110-905a64261216 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.245784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78768b81-0876-499a-9110-905a64261216 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.256515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 460/934] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:40.258601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78768b81-0876-499a-9110-905a64261216 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:40.287049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21508027-1b3c-449f-ba4a-8254a3d9563d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.288847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:40.327249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.327872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.328155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.328431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.341821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.343417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:40.360643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:40.361651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:40.362610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:40.362610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:40.362610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:40.366662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 475/935] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:40.367615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:40.382568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78768b81-0876-499a-9110-905a64261216 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.423250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1a16ac-f2a7-429d-b82b-4835ffc2e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.424297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a16ac-f2a7-429d-b82b-4835ffc2e48b None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.424772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a16ac-f2a7-429d-b82b-4835ffc2e48b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.425293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1a16ac-f2a7-429d-b82b-4835ffc2e48b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.426178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a16ac-f2a7-429d-b82b-4835ffc2e48b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.427802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1a16ac-f2a7-429d-b82b-4835ffc2e48b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.482943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4251b34-60c6-4e54-b93a-86404e40c1ba None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.518188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b33da7-7a15-4564-a2e4-b345cd48abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.521500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b33da7-7a15-4564-a2e4-b345cd48abcb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.521500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b33da7-7a15-4564-a2e4-b345cd48abcb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.521500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b33da7-7a15-4564-a2e4-b345cd48abcb None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.521500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b33da7-7a15-4564-a2e4-b345cd48abcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:40.521500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b33da7-7a15-4564-a2e4-b345cd48abcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.521899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b33da7-7a15-4564-a2e4-b345cd48abcb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.534130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 476/936] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:40.535378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94442-4a69-44bf-b067-1f51003b2b09 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.535669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94442-4a69-44bf-b067-1f51003b2b09 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.535942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a94442-4a69-44bf-b067-1f51003b2b09 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.537354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 477/937] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:40 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:40.540002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94442-4a69-44bf-b067-1f51003b2b09 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:40.557581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 461/938] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:40.559338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44340772-9780-4350-897d-5d941bb1ee28 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.559842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44340772-9780-4350-897d-5d941bb1ee28 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.560364 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44340772-9780-4350-897d-5d941bb1ee28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.576847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:40.580742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-44340772-9780-4350-897d-5d941bb1ee28 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:40.582360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-44340772-9780-4350-897d-5d941bb1ee28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:40.592327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:40.683057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 462/939] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:40.707285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a94442-4a69-44bf-b067-1f51003b2b09 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.758698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.759772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.760636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.760889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.765623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfb1f9-3bf3-40fe-a2f2-e84adf73426f None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.765623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfb1f9-3bf3-40fe-a2f2-e84adf73426f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.765623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dfb1f9-3bf3-40fe-a2f2-e84adf73426f None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.768072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 463/940] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:40.769098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.770563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.772780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405872c4-f557-4792-9c17-d8be2f84cb92 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.773068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405872c4-f557-4792-9c17-d8be2f84cb92 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.773347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405872c4-f557-4792-9c17-d8be2f84cb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:40.784144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:40.785364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:40.786632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 478/941] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:38:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:40.792922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:40.798526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-405872c4-f557-4792-9c17-d8be2f84cb92 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:40.799794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-405872c4-f557-4792-9c17-d8be2f84cb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:40.898209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 464/942] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:40.901229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:40.916349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9aca14-6d0b-47ab-8f27-642105712f1e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:40.961216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:40.962154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:40.962622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:40.963152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:40.964089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:40.964581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:40.966209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:40.985149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405872c4-f557-4792-9c17-d8be2f84cb92 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:40.987420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 479/943] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 06:38:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:40.993410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.079445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:41.109504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33122e63-e23b-4338-a0e0-7bbf1f7616ec None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.128108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405872c4-f557-4792-9c17-d8be2f84cb92 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.149433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:41.156161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.157363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.158052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.158486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.172011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.173117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.173832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.174098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.174703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.175247 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.176280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.178424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.181433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING keystone.server.flask.common [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:41.191189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:41.192353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:41.193254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:41.193254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:41.193254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:41.198940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 480/944] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:41.200074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.253087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.sql.core [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 06:38:41.253087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 06:38:41.253087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [parameters: {'id': 'c4a025d7a227452bacd6fe5eb211de5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 06:38:41.253087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93391) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4a025d7a227452bacd6fe5eb211de5b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4a025d7a227452bacd6fe5eb211de5b. Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application conn.query(q) Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 06:38:41.260529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result.read() Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 24 06:38:41.261363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application next(self.gen) Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application yield resource Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application next(self.gen) Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise self.value Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application session.commit() Aug 24 06:38:41.262287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.session.flush() Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application compat.raise_( Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 06:38:41.263950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 06:38:41.264963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application conn.query(q) Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result.read() Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 06:38:41.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [parameters: {'id': 'c4a025d7a227452bacd6fe5eb211de5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.266602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:41.268100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c4a025d7a227452bacd6fe5eb211de5b. Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 465/945] 10.222.0.59 () {60 vars in 1140 bytes} [Wed Aug 24 06:38:40 2022] POST /identity/v3/projects => generated 262 bytes in 277 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:41.269254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.326647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f3bfd-910e-483c-b189-6f7003b408bf None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.364071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.364747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.365014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.365289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.366019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.367606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.375960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d9c2ff-b987-4af9-8e7a-78b4553d1e75 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:41.377386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:41.382851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:41.384018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 481/946] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:41.385032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.409508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:41.422313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.425146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.425146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.425146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.425146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:41.425146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.426092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.448275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 466/947] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:41.448275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.455139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:41.523007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd28c7-bcfc-4aed-a9e6-ab057e6b83d4 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.572420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.573722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.574031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde0349-6adb-410c-a831-a89507c20d34 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.574404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.575020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.586419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.587956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:41.600788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:41.601844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 482/948] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:41.602733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.625139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.625762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.626043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.626318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.627178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:41.627338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.628761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.638454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 467/949] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:41.638454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.708457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:41.729349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076aee6f-20b1-4c2a-91a4-88483bb2c271 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.740096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:41.766449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4f713-c7d6-47b0-8afc-e24c943b8a92 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.770028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.770687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.770998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.771275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.779549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.781039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:41.797826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:41.799157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 483/950] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:41.800231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.814002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:41.814612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:41.814984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:41.815259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:41.815922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:41.816222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:41.817637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:41.834556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 468/951] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:41.835412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:41.973001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15878c5b-6fc6-4eea-86db-f9d8d0d9d433 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.975530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c73c668-5b58-4f51-b1f1-5471378a50ad None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:41.990016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:42.021458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:42.022079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:42.022362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:42.022636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:42.023354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:42.023689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:42.025087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:42.029996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:42.030978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:42.031477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:42.031597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 484/952] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:42.032049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:42.032741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:42.033053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:42.034578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:42.036921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:42.052571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 469/953] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:42.058562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:42.080137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:42.175782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9e21d-fc77-4f12-a1eb-6e222448e9f0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:42.191619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2989cc2-3373-4c4c-bf02-33e43f0fcc70 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:42.223816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4527ff-b923-4c46-91ef-87b16ec3e525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:42.224443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4527ff-b923-4c46-91ef-87b16ec3e525 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:42.225143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4527ff-b923-4c46-91ef-87b16ec3e525 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:42.225423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4527ff-b923-4c46-91ef-87b16ec3e525 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:42.226372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4527ff-b923-4c46-91ef-87b16ec3e525 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:42.228426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4527ff-b923-4c46-91ef-87b16ec3e525 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:42.233220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c9f88-d2b7-4243-95d4-5768c3af6881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:42.233969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9f88-d2b7-4243-95d4-5768c3af6881 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:42.234335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9f88-d2b7-4243-95d4-5768c3af6881 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:42.234686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c9f88-d2b7-4243-95d4-5768c3af6881 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/59375961363e484ca6607126bbf0741b/roles/d9d7e56793ab4546a30f2273fa612371` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:42.237131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9f88-d2b7-4243-95d4-5768c3af6881 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=59375961363e484ca6607126bbf0741b, role_id=d9d7e56793ab4546a30f2273fa612371)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:42.238675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c9f88-d2b7-4243-95d4-5768c3af6881 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:42.317381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 485/954] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:42 2022] POST /identity/v3/endpoints => generated 349 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:42.336053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 470/955] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:38:42 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/59375961363e484ca6607126bbf0741b/roles/d9d7e56793ab4546a30f2273fa612371 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:38:42.651977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7862c6-dc8e-469a-b763-e4ea0c45c232 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:42.652709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7862c6-dc8e-469a-b763-e4ea0c45c232 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:42.652709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7862c6-dc8e-469a-b763-e4ea0c45c232 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:42.654089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 486/956] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:42.660223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0f160-9b39-46bf-b57d-ee54ab65b5a8 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:42.660606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0f160-9b39-46bf-b57d-ee54ab65b5a8 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:42.660853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0f160-9b39-46bf-b57d-ee54ab65b5a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:42.681452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d6f0f160-9b39-46bf-b57d-ee54ab65b5a8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:42.683701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d6f0f160-9b39-46bf-b57d-ee54ab65b5a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:42.716751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:42.778490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 471/957] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:43.050529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7862c6-dc8e-469a-b763-e4ea0c45c232 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:43.152181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:43.168037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7862c6-dc8e-469a-b763-e4ea0c45c232 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:43.204376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:43.205015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:43.205298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:43.210374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] PATH_INFO: `/v3/services/compute` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:43.210374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:43.210374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:43.216671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:43.218007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:43.218953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 487/958] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:43.226655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0f160-9b39-46bf-b57d-ee54ab65b5a8 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:43.342545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0f160-9b39-46bf-b57d-ee54ab65b5a8 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:43.378308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f5cf91-c0d0-48c7-a4f8-83db719a257f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:43.378954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cf91-c0d0-48c7-a4f8-83db719a257f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:43.379235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cf91-c0d0-48c7-a4f8-83db719a257f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:43.379508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f5cf91-c0d0-48c7-a4f8-83db719a257f None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:43.380146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5cf91-c0d0-48c7-a4f8-83db719a257f None admin] RBAC: Adding query filter params (name=compute) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:43.380448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5cf91-c0d0-48c7-a4f8-83db719a257f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:43.381806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f5cf91-c0d0-48c7-a4f8-83db719a257f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:43.387264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 472/959] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:43.395905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:43.503438 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1b108-672d-47a2-b336-c45ecb4a1fcb None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:43.542300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b69c5d-43b8-494e-a2a0-4377a1d42bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:43.542939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b69c5d-43b8-494e-a2a0-4377a1d42bae None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:43.543223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b69c5d-43b8-494e-a2a0-4377a1d42bae None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:43.543498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b69c5d-43b8-494e-a2a0-4377a1d42bae None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:43.544135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b69c5d-43b8-494e-a2a0-4377a1d42bae None admin] RBAC: Adding query filter params (type=compute) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:43.544439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b69c5d-43b8-494e-a2a0-4377a1d42bae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:43.545809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b69c5d-43b8-494e-a2a0-4377a1d42bae None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:43.550929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 488/960] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:43.955799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b772-7b8a-489c-82bc-c1f202eddd5a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:43.956292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b772-7b8a-489c-82bc-c1f202eddd5a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:43.956447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f5b772-7b8a-489c-82bc-c1f202eddd5a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:43.958061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 473/961] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:43.963963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e7ed-9bb1-49e0-9d23-7640285a2c1c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:43.964738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e7ed-9bb1-49e0-9d23-7640285a2c1c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:43.964738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0982e7ed-9bb1-49e0-9d23-7640285a2c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:43.984105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0982e7ed-9bb1-49e0-9d23-7640285a2c1c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:43.985265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0982e7ed-9bb1-49e0-9d23-7640285a2c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:44.000444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:44.067945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 489/962] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:44.344898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b772-7b8a-489c-82bc-c1f202eddd5a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:44.365904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:44.458646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f5b772-7b8a-489c-82bc-c1f202eddd5a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:44.496039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:44.496662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:44.496949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:44.497228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:44.497886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:44.499343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:44.556442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.sql.core [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 06:38:44.556442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 06:38:44.556442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [parameters: {'user_id': 'a7479e6454d74655872469886f0778f2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 06:38:44.556442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=93391) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application conn.query(q) Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result.read() Aug 24 06:38:44.564094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 06:38:44.567433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application next(self.gen) Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application yield resource Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application next(self.gen) Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.session.rollback() Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.force_reraise() Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise self.value Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application session.commit() Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 24 06:38:44.575701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._prepare_impl() Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.session.flush() Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._flush(objects) Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application compat.raise_( Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application flush_context.execute() Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rec.execute(self) Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 24 06:38:44.579071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 24 06:38:44.582446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result = self._query(query) Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application conn.query(q) Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application result.read() Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 24 06:38:44.585689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a7479e6454d74655872469886f0778f2', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:44.599665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 24 06:38:44.602741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 24 06:38:44.606699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 24 06:38:44.606699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 24 06:38:44.606699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 24 06:38:44.606699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 24 06:38:44.606699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 24 06:38:44.606699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:44.606699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 474/963] 10.222.0.59 () {60 vars in 1131 bytes} [Wed Aug 24 06:38:44 2022] POST /identity/v3/users => generated 160 bytes in 221 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:44.608140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e7ed-9bb1-49e0-9d23-7640285a2c1c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:44.679871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0982e7ed-9bb1-49e0-9d23-7640285a2c1c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:44.727753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3a5166-3724-4227-a354-dc8b7e9d1315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:44.727753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5166-3724-4227-a354-dc8b7e9d1315 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:44.727753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5166-3724-4227-a354-dc8b7e9d1315 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:44.727753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3a5166-3724-4227-a354-dc8b7e9d1315 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:44.731529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a5166-3724-4227-a354-dc8b7e9d1315 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:44.733050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3a5166-3724-4227-a354-dc8b7e9d1315 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-6b3a5166-3724-4227-a354-dc8b7e9d1315 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:44.745983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:44.748304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:44.750476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 490/964] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:44 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:44.754790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:44.840751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6fcfc-d21a-44af-82f4-8eac6563d273 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:44.841159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6fcfc-d21a-44af-82f4-8eac6563d273 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:44.841387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d6fcfc-d21a-44af-82f4-8eac6563d273 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:44.842933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 491/965] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:44.847163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:44.851828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ec80-9fee-4983-8831-2365e783db43 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:44.852156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ec80-9fee-4983-8831-2365e783db43 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:44.852343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad7ec80-9fee-4983-8831-2365e783db43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:44.868637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:44.871753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-1ad7ec80-9fee-4983-8831-2365e783db43 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:44.873011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1ad7ec80-9fee-4983-8831-2365e783db43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:44.882981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42949d-28ad-4eba-b77e-ac76212ffae6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:44.934718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:44.935781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:44.936089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:44.936366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:44.937578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] RBAC: Adding query filter params (name=cinder) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:44.938064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:44.940465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:44.986061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 492/966] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:44.987163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052066-7f9f-43c6-ad41-d95173dd72f9 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:44.987450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052066-7f9f-43c6-ad41-d95173dd72f9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:44.987726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41052066-7f9f-43c6-ad41-d95173dd72f9 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:44.993488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 493/967] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:44.995164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871fea-fd86-4f4c-8b15-b6fb81a2ff93 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:44.995554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871fea-fd86-4f4c-8b15-b6fb81a2ff93 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:44.995928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32871fea-fd86-4f4c-8b15-b6fb81a2ff93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:44.999928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 475/968] 10.222.0.59 () {56 vars in 1101 bytes} [Wed Aug 24 06:38:44 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:45.017615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-32871fea-fd86-4f4c-8b15-b6fb81a2ff93 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:45.019346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-32871fea-fd86-4f4c-8b15-b6fb81a2ff93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:45.104565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 494/969] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:45.267044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.382751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32871fea-fd86-4f4c-8b15-b6fb81a2ff93 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.385488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e9194-3987-4e9f-8cba-e0e3836dc44d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:45.423036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:45.423685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.423974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.424252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.432816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:45.437382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:45.442590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:45.460086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 476/970] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:45.460941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.461697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:45.511210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32871fea-fd86-4f4c-8b15-b6fb81a2ff93 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:45.567700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f01fdd-11f3-4f6c-9467-bb8e78384122 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:45.572855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:45.573893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.574484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.575013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.576062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:45.578641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:45.595156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:45.596240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:45.597109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:45.598551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 495/971] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:45.603620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.609994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3453183-186a-4164-bc12-7b26d8673dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:45.610611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453183-186a-4164-bc12-7b26d8673dfe None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.610929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453183-186a-4164-bc12-7b26d8673dfe None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.611206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3453183-186a-4164-bc12-7b26d8673dfe None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.611880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453183-186a-4164-bc12-7b26d8673dfe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:45.612185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453183-186a-4164-bc12-7b26d8673dfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:45.613547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3453183-186a-4164-bc12-7b26d8673dfe None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:45.623063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 477/972] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:45.624577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05049f4-d302-4db9-85fa-20a2fa18a7d7 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.624868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05049f4-d302-4db9-85fa-20a2fa18a7d7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.625152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05049f4-d302-4db9-85fa-20a2fa18a7d7 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.626547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 478/973] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:45.628816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05049f4-d302-4db9-85fa-20a2fa18a7d7 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.690506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:45.725101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f94ca8-5bb1-4266-9aad-c11957e947a5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:45.744718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05049f4-d302-4db9-85fa-20a2fa18a7d7 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:45.755602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:45.761509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc6bcb-ecfc-4091-8415-d5161dab16cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:45.762130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6bcb-ecfc-4091-8415-d5161dab16cd None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.762406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6bcb-ecfc-4091-8415-d5161dab16cd None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.762680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc6bcb-ecfc-4091-8415-d5161dab16cd None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.763361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6bcb-ecfc-4091-8415-d5161dab16cd None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:45.763659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6bcb-ecfc-4091-8415-d5161dab16cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:45.767786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc6bcb-ecfc-4091-8415-d5161dab16cd None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:45.770327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 496/974] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:45.771618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b90df6-61f6-4a61-988f-b6e47cca4c3f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.771907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b90df6-61f6-4a61-988f-b6e47cca4c3f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.772188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b90df6-61f6-4a61-988f-b6e47cca4c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.786832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:45.787479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.787758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.788031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.792500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-98b90df6-61f6-4a61-988f-b6e47cca4c3f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:45.793723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-98b90df6-61f6-4a61-988f-b6e47cca4c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:45.800130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:45.801585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:45.818587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:45.820356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:45.821777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:45.821777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:45.821777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:45.821777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 479/975] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:45.821777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.872682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 497/976] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:45.873556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b90df6-61f6-4a61-988f-b6e47cca4c3f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.934869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76fd368-0b1b-4eae-9999-17b40213de89 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:45.948225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:45.969331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:45.970045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:45.970326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:45.970600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:45.971274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:45.971563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:45.972997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:45.977826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 480/977] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:45.984337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:45.992324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b90df6-61f6-4a61-988f-b6e47cca4c3f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:46.020590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:46.032250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:46.032961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:46.033249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:46.033528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:46.034191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:46.034582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:46.036072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:46.052323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 498/978] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:46.059059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:46.117408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a81e8-6f85-4463-9eae-37d663897137 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:46.155735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:46.156349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:46.156630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:46.156905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:46.157630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] RBAC: Adding query filter params (interface=admin, service_id=4290707960194b48a11a74ecea0678ed, region_id=RegionOne) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:46.157940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:46.159372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:46.164952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 481/979] 10.222.0.59 () {56 vars in 1249 bytes} [Wed Aug 24 06:38:45 2022] GET /identity/v3/endpoints?service_id=4290707960194b48a11a74ecea0678ed&interface=admin®ion_id=RegionOne => generated 193 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:46.165763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:46.188899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4c5a4a-7853-4aef-b26a-55cde9749ac5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:46.210572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:46.237673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:46.238311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:46.238591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:46.238888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:46.246875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:46.248716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:46.260421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:46.261554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:46.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 499/980] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:38:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:46.263163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:46.278306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0986b8db-9a1e-4e27-9c3d-d56abd64d5da None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:46.313212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:46.314242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:46.314802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:46.315080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:46.315358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:46.316014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:46.317388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:46.371444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1770760-2253-438f-9f70-e002b423f0ce None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:46.406405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:46.407046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:46.407332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:46.407608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:46.408225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:46.409006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 482/981] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:46 2022] POST /identity/v3/services => generated 242 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:46.409689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:46.409970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:46.421036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 500/982] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:46 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:38:46.553184 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:46.566755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ec7ff7-3249-49c6-88bf-a4e4b0891aa5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:46.612034 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:46.613043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:46.613535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:46.614060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:46.615095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:46.615634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:46.617141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:46.638416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 483/983] 10.222.0.59 () {56 vars in 1149 bytes} [Wed Aug 24 06:38:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:46.644707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:46.780101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37af9b-daf7-43fa-b1eb-dedb9431b25f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:46.789306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:46.816331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:46.816855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:46.817132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:46.817404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:46.903781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:46.905863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:47.027072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 501/984] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:46 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:38:47.032719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:47.142094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8661a5-b203-4227-9c15-271005477cd2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:47.177695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:47.178331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:47.178614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:47.178923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:47.194185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:47.195699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:47.211055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:47.212039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:47.217880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:47.217880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:47.217880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:47.217880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 484/985] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:47.218106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:47.228733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:47.319759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4c368-92f1-4f45-9fe1-147ae063ce62 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:47.354137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:47.354780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:47.355073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:47.355347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:47.356013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:47.356317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:47.357700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:47.374052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 502/986] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:47.375490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:47.384941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:47.497600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2015356-4aea-48f4-97e6-3100859b918c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:47.536443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:47.537090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:47.537366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:47.537633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:47.546490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:47.547972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:47.560359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:47.561459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:47.562487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 485/987] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:47.567293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:47.644864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:47.681039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10baa58f-6080-44fe-a82e-58b2ba9ff9b1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:47.725348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea277b0-d9bf-4318-b993-1dc874ebe95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:47.725958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea277b0-d9bf-4318-b993-1dc874ebe95a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:47.726236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea277b0-d9bf-4318-b993-1dc874ebe95a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:47.726519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea277b0-d9bf-4318-b993-1dc874ebe95a None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:47.727232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea277b0-d9bf-4318-b993-1dc874ebe95a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:47.727537 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea277b0-d9bf-4318-b993-1dc874ebe95a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:47.729519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea277b0-d9bf-4318-b993-1dc874ebe95a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:47.743565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 503/988] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:47.749765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:47.830887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:47.899195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32468d60-d431-4cde-b9ea-dfdbc80ce386 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:47.953025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b872eb7-c079-466c-8155-6bbe3feb4b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:47.954083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b872eb7-c079-466c-8155-6bbe3feb4b8b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:47.954591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b872eb7-c079-466c-8155-6bbe3feb4b8b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:47.955147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b872eb7-c079-466c-8155-6bbe3feb4b8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:47.956563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b872eb7-c079-466c-8155-6bbe3feb4b8b None admin] RBAC: Adding query filter params (role.id=d9d7e56793ab4546a30f2273fa612371, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=59375961363e484ca6607126bbf0741b) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:47.957136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b872eb7-c079-466c-8155-6bbe3feb4b8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:47.960053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b872eb7-c079-466c-8155-6bbe3feb4b8b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:47.977402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 486/989] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:47 2022] GET /identity/v3/role_assignments?user.id=59375961363e484ca6607126bbf0741b&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=d9d7e56793ab4546a30f2273fa612371 => generated 608 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:48.397704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681769d6-37cf-4234-93e8-b28d30ae54a4 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:48.398246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681769d6-37cf-4234-93e8-b28d30ae54a4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:48.398246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681769d6-37cf-4234-93e8-b28d30ae54a4 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:48.399645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 504/990] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:48.406503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8041-80fb-4385-b46f-d307f9f47513 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:48.406874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8041-80fb-4385-b46f-d307f9f47513 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:48.407154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413e8041-80fb-4385-b46f-d307f9f47513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:48.430437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-413e8041-80fb-4385-b46f-d307f9f47513 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:48.432549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-413e8041-80fb-4385-b46f-d307f9f47513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:48.460299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049114-7731-46d1-843f-73d05fe05e06 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:48.460639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049114-7731-46d1-843f-73d05fe05e06 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:48.460845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84049114-7731-46d1-843f-73d05fe05e06 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:48.462388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 505/991] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:48.469419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b299c23-d206-40f2-9f56-d6790b412af7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:48.469748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b299c23-d206-40f2-9f56-d6790b412af7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:48.470474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b299c23-d206-40f2-9f56-d6790b412af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:48.492466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9b299c23-d206-40f2-9f56-d6790b412af7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:48.494269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9b299c23-d206-40f2-9f56-d6790b412af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:48.526222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 487/992] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:48.578798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 506/993] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:48.794183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e8041-80fb-4385-b46f-d307f9f47513 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:48.844526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b299c23-d206-40f2-9f56-d6790b412af7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:48.856340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:48.905704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413e8041-80fb-4385-b46f-d307f9f47513 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:48.907499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:48.946006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:48.946674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:48.947083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:48.947256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:48.948029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:48.949362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:48.952458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b299c23-d206-40f2-9f56-d6790b412af7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:48.959381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:48.960595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 24 06:38:48.961569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:48.964192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 488/994] 10.222.0.59 () {56 vars in 1126 bytes} [Wed Aug 24 06:38:48 2022] GET /identity/v3/services/object-store => generated 93 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:48.970106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:48.999303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.000139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.000659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.001171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.002284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.005000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:49.021725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:49.023344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:49.024186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 507/995] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:49.029772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:49.100386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd867fe8-d4e0-4213-963a-fb062eb674ae None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:49.130652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:49.144604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.146897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d251fdd1-eaf4-47cd-85cd-84d923aa7522 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:49.147005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.147005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.147005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.147005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:49.147005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.148304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.154151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 489/996] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:49.159765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:49.171602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:49.185722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.186330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.186610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.186927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.187559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] RBAC: Adding query filter params (name=compute) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:49.187860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.189281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.198275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 508/997] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:49.200406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:49.275705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ec7c-601b-40af-83a0-cc1845d84068 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:49.308771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689cfd2f-d572-45f8-9c81-b1c16faf888e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:49.311125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.311730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.312017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.312294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.312929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:49.313233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.314585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.319934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 490/998] 10.222.0.59 () {56 vars in 1122 bytes} [Wed Aug 24 06:38:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:49.325447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:49.348934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.349547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.349829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.350102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.350740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:49.351072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.352437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.358701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 509/999] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:49.364292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:49.391116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:49.417434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:49.438527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16614a9a-6cb9-4458-b78d-c31f82810b48 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:49.469179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe26ee-dd21-4c29-85c1-b317ac339ed1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:49.476399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8499ed11-4f17-4088-a6cd-c79a75947814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.477014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ed11-4f17-4088-a6cd-c79a75947814 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.477294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ed11-4f17-4088-a6cd-c79a75947814 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.477567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8499ed11-4f17-4088-a6cd-c79a75947814 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.478253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499ed11-4f17-4088-a6cd-c79a75947814 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.479764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8499ed11-4f17-4088-a6cd-c79a75947814 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.504545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.505159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.505444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.505723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.506427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] RBAC: Adding query filter params (interface=public, service_id=6e4329b6a93f488e96bd2159ea2eb96b, region_id=RegionOne) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:49.506740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.508145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.514110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 510/1000] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:38:49 2022] GET /identity/v3/endpoints?service_id=6e4329b6a93f488e96bd2159ea2eb96b&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:49.519814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:49.590801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 491/1001] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:49.639134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07be6f1a-9ead-4e02-87bb-137ac7317ed8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:49.655676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:49.685414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cc779c-3837-4665-b6ac-1ccef63a1e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:49.686042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc779c-3837-4665-b6ac-1ccef63a1e8e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.686324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc779c-3837-4665-b6ac-1ccef63a1e8e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.686598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cc779c-3837-4665-b6ac-1ccef63a1e8e None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.687318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc779c-3837-4665-b6ac-1ccef63a1e8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:49.688795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cc779c-3837-4665-b6ac-1ccef63a1e8e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:49.702794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 511/1002] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:49 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:38:49.939645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5c91-eaaa-4fd4-8f9e-3ac6545a62b3 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.939952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5c91-eaaa-4fd4-8f9e-3ac6545a62b3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.940138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b5c91-eaaa-4fd4-8f9e-3ac6545a62b3 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.941670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 492/1003] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:49.947738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8a218-6735-42d3-835c-cd032e80bb7d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:49.948018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8a218-6735-42d3-835c-cd032e80bb7d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:49.948290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f8a218-6735-42d3-835c-cd032e80bb7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:49.967552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-82f8a218-6735-42d3-835c-cd032e80bb7d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:49.968775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-82f8a218-6735-42d3-835c-cd032e80bb7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:50.059449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 512/1004] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:50.323577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5c91-eaaa-4fd4-8f9e-3ac6545a62b3 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:50.439746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b5c91-eaaa-4fd4-8f9e-3ac6545a62b3 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:50.453587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:50.475355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:50.475998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:50.476280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:50.476556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] PATH_INFO: `/v3/services/image` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:50.477151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:50.479060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:50.488042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:50.489076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:50.489956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:50.494897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 493/1005] 10.222.0.59 () {56 vars in 1105 bytes} [Wed Aug 24 06:38:50 2022] GET /identity/v3/services/image => generated 86 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:50.496219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8a218-6735-42d3-835c-cd032e80bb7d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:50.601741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f8a218-6735-42d3-835c-cd032e80bb7d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:50.604699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:50.637763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a343857-3c4a-4725-a1d0-34b775f1cb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:50.638383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a343857-3c4a-4725-a1d0-34b775f1cb64 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:50.638723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a343857-3c4a-4725-a1d0-34b775f1cb64 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:50.639037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a343857-3c4a-4725-a1d0-34b775f1cb64 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:50.639679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a343857-3c4a-4725-a1d0-34b775f1cb64 None admin] RBAC: Adding query filter params (name=image) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:50.639984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a343857-3c4a-4725-a1d0-34b775f1cb64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:50.641355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a343857-3c4a-4725-a1d0-34b775f1cb64 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:50.651629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 513/1006] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:50.652682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:50.763500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab303b-70f8-4592-be8b-bf02f5df3f22 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:50.799142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f03a-fdc6-4fe3-b257-028bbb0258e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:50.799750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f03a-fdc6-4fe3-b257-028bbb0258e3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:50.800030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f03a-fdc6-4fe3-b257-028bbb0258e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:50.800304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f03a-fdc6-4fe3-b257-028bbb0258e3 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:50.800938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f03a-fdc6-4fe3-b257-028bbb0258e3 None admin] RBAC: Adding query filter params (type=image) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:50.801246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f03a-fdc6-4fe3-b257-028bbb0258e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:50.802598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f03a-fdc6-4fe3-b257-028bbb0258e3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:50.807521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 494/1007] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:51.592902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bd76a-01ce-45b2-8289-71ffc1d54f8d None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:51.593485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bd76a-01ce-45b2-8289-71ffc1d54f8d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:51.593485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bd76a-01ce-45b2-8289-71ffc1d54f8d None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:51.595065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 514/1008] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:51.600269 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b0810-0907-42e2-9b2c-01f1a8d1160e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:51.600559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b0810-0907-42e2-9b2c-01f1a8d1160e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:51.600840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226b0810-0907-42e2-9b2c-01f1a8d1160e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:51.619422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-226b0810-0907-42e2-9b2c-01f1a8d1160e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:51.620617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-226b0810-0907-42e2-9b2c-01f1a8d1160e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:51.657664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:51.680415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e087fa-8d71-4e3e-8277-31706efb5cfc None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:51.680748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e087fa-8d71-4e3e-8277-31706efb5cfc None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:51.680999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e087fa-8d71-4e3e-8277-31706efb5cfc None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:51.682534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 515/1009] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:51.687851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6995-eef9-48f3-891c-f0ee44a4eab1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:51.688142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6995-eef9-48f3-891c-f0ee44a4eab1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:51.688472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0c6995-eef9-48f3-891c-f0ee44a4eab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:51.703351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 495/1010] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:51.717762 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-8d0c6995-eef9-48f3-891c-f0ee44a4eab1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:51.719094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8d0c6995-eef9-48f3-891c-f0ee44a4eab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:51.790656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 516/1011] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:51.970294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b0810-0907-42e2-9b2c-01f1a8d1160e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:52.060310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c6995-eef9-48f3-891c-f0ee44a4eab1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:52.084596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226b0810-0907-42e2-9b2c-01f1a8d1160e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:52.121676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:52.122323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.122614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.122945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.124119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:52.125628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:52.127256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 496/1012] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:52.132891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:52.164194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:52.168385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0c6995-eef9-48f3-891c-f0ee44a4eab1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:52.177534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:52.206509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:52.207220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.207493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.207764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] PATH_INFO: `/v3/services/compute` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.208349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:52.209732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:52.220003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:52.221147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 24 06:38:52.222009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:52.226181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 517/1013] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:52 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:52.226963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:52.248787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a731367-3fff-4a68-b088-5579eddc164f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:52.294345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:52.294997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.295304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.295567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.296221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:52.297655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:52.349339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5379e51-86ad-487d-adf9-d9d41f77d725 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:52.385359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:52.385977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.386257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.386536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.387258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] RBAC: Adding query filter params (name=compute) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:52.387659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:52.389070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:52.394137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 518/1014] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:52.399690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:52.426793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 497/1015] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:52 2022] POST /identity/v3/projects => generated 311 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:52.435084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:52.525525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4189450-502a-4c70-810f-707b7420ff9d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:52.571838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbce93-70d5-4ebb-ac44-463e5887cd8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:52.572471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbce93-70d5-4ebb-ac44-463e5887cd8f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.572769 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbce93-70d5-4ebb-ac44-463e5887cd8f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.573111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbce93-70d5-4ebb-ac44-463e5887cd8f None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.573766 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbce93-70d5-4ebb-ac44-463e5887cd8f None admin] RBAC: Adding query filter params (type=compute) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:52.574074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbce93-70d5-4ebb-ac44-463e5887cd8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:52.575557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbce93-70d5-4ebb-ac44-463e5887cd8f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:52.581536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 519/1016] 10.222.0.59 () {56 vars in 1112 bytes} [Wed Aug 24 06:38:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:52.587613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:52.711708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:52.726310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0b70b9-016f-4900-9543-4ff3eb63e174 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:52.759349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03d21-47d1-4ea5-a6f4-d46fac4b23c9 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.760064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03d21-47d1-4ea5-a6f4-d46fac4b23c9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.760064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec03d21-47d1-4ea5-a6f4-d46fac4b23c9 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.761569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 520/1017] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:52.767149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a81942-b578-4478-b274-dfcfca81e821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:52.768773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a81942-b578-4478-b274-dfcfca81e821 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.769511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd41a-5603-4378-a04d-f11a4a58e3e1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:52.770043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd41a-5603-4378-a04d-f11a4a58e3e1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.770176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a81942-b578-4478-b274-dfcfca81e821 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:52.770811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a81942-b578-4478-b274-dfcfca81e821 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.770924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fd41a-5603-4378-a04d-f11a4a58e3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:52.771584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a81942-b578-4478-b274-dfcfca81e821 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:52.774210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a81942-b578-4478-b274-dfcfca81e821 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:52.797951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f67fd41a-5603-4378-a04d-f11a4a58e3e1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:52.799248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f67fd41a-5603-4378-a04d-f11a4a58e3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:52.869785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 521/1018] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:52 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:52.893915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 498/1019] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:53.137850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fd41a-5603-4378-a04d-f11a4a58e3e1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:53.168700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:53.304131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fd41a-5603-4378-a04d-f11a4a58e3e1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:53.372544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0059d7da-dfc1-46db-b7c5-40a9d99717f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:53.373579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d7da-dfc1-46db-b7c5-40a9d99717f9 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:53.374074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d7da-dfc1-46db-b7c5-40a9d99717f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:53.374553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0059d7da-dfc1-46db-b7c5-40a9d99717f9 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:53.375767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059d7da-dfc1-46db-b7c5-40a9d99717f9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:53.378316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0059d7da-dfc1-46db-b7c5-40a9d99717f9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:53.510943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 522/1020] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:38:53 2022] POST /identity/v3/services => generated 242 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:38:54.435577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a6d4-873c-44f3-8ab8-661e9e3cc127 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:54.436104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a6d4-873c-44f3-8ab8-661e9e3cc127 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:54.436209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3445a6d4-873c-44f3-8ab8-661e9e3cc127 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:54.437550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 499/1021] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:54.443915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8472e8-92f3-4a02-83e2-3cda188c565b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:54.444407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8472e8-92f3-4a02-83e2-3cda188c565b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:54.445032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8472e8-92f3-4a02-83e2-3cda188c565b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:54.475550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-cd8472e8-92f3-4a02-83e2-3cda188c565b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:54.476775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cd8472e8-92f3-4a02-83e2-3cda188c565b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:54.569551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 523/1022] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:54.842778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445a6d4-873c-44f3-8ab8-661e9e3cc127 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:54.950694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f97b9-8ea3-43f4-b02a-37140adf497b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:54.950994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f97b9-8ea3-43f4-b02a-37140adf497b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:54.951280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9f97b9-8ea3-43f4-b02a-37140adf497b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:54.952837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 524/1023] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:54.954479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3445a6d4-873c-44f3-8ab8-661e9e3cc127 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:54.957732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b365bd-f542-4929-8bf0-0965b08e5678 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:54.958016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b365bd-f542-4929-8bf0-0965b08e5678 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:54.958294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b365bd-f542-4929-8bf0-0965b08e5678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:54.964646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:54.978016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-76b365bd-f542-4929-8bf0-0965b08e5678 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:54.978549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-76b365bd-f542-4929-8bf0-0965b08e5678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:54.996622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:54.996622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:54.996938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:54.997069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:54.998234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:54.999792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:55.001676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 500/1024] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:55.008140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:55.027062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:55.073704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 525/1025] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:55.137964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d388c2-cbeb-4170-9af8-67ddf239e371 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:55.194878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7a9c2b-ff0f-41b3-a668-5a0a0ff7993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:55.195930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a9c2b-ff0f-41b3-a668-5a0a0ff7993d None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:55.196462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a9c2b-ff0f-41b3-a668-5a0a0ff7993d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:55.197188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7a9c2b-ff0f-41b3-a668-5a0a0ff7993d None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:55.198514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a9c2b-ff0f-41b3-a668-5a0a0ff7993d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:55.201265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7a9c2b-ff0f-41b3-a668-5a0a0ff7993d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:55.291162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 501/1026] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:38:55 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:38:55.346538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b365bd-f542-4929-8bf0-0965b08e5678 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:55.459206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b365bd-f542-4929-8bf0-0965b08e5678 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:55.490735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:55.491694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aefdb-bf51-4b0d-9a97-f9c9eba7ba8b None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:55.492136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aefdb-bf51-4b0d-9a97-f9c9eba7ba8b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:55.492273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815aefdb-bf51-4b0d-9a97-f9c9eba7ba8b None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:55.493637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 502/1027] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:55.498452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:55.499124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4445-4d5d-4567-94ca-777c05ab6885 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:55.499253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:55.499449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:55.499556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4445-4d5d-4567-94ca-777c05ab6885 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:55.499706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:55.499844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57a4445-4d5d-4567-94ca-777c05ab6885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:55.515241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:55.518978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:55.519931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:55.520794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 526/1028] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 06:38:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:55.527087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b57a4445-4d5d-4567-94ca-777c05ab6885 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:55.527246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:55.527829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b57a4445-4d5d-4567-94ca-777c05ab6885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:55.592868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:55.598251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 503/1029] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:55.629596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d81f7-a2d2-41f4-b07a-172e19f488b1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:55.664753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:55.665654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:55.665937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:55.666207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:55.666912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:55.667219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:55.668610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:55.677240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 527/1030] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 06:38:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:55.682815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a4445-4d5d-4567-94ca-777c05ab6885 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:55.793102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57a4445-4d5d-4567-94ca-777c05ab6885 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:55.831952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:55.832616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:55.832893 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:55.833169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:55.844300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:55.845686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:55.860782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:55.861787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:55.862694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:55.862694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:55.862694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:55.866802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 504/1031] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:55.868625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:55.871605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:55.931111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:55.935079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:55.978922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728f1fe-b787-4d0e-9b72-6b15604d7126 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:55.980665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e95516-0959-41e2-ac8c-aed77f7a58af None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.014757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.015412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.015689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.015959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] PATH_INFO: `/v3/services/image` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.016543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.017562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.017895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.018181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.018797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.019067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.019721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:56.020032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.021396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:56.026959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:56.027930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:56.031770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 505/1032] 10.222.0.59 () {56 vars in 1105 bytes} [Wed Aug 24 06:38:55 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:56.033793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.036711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 528/1033] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:56.042258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.142420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cc6edc-d8a7-4147-acbf-aa3f5c6de7fa None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.148871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e17960-a22d-4732-badc-b3884a82f8ec None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.158964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:56.167790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:56.178905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.179795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.180319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.181266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.182065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] RBAC: Adding query filter params (name=image) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:56.182411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.183808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.188807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.189440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.189731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.190007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] PATH_INFO: `/v3/users/nova` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.190911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 506/1034] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:56.194783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.200660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.202108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:38:56.214638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:56.217616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:56.221229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 529/1035] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:38:56.224521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.313350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189b3b1b-0957-4d11-94a2-c479b3d878e3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.340485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b4c66-9013-49be-9085-7301ebbae80d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.351943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.353088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.353376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.353633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.354270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] RBAC: Adding query filter params (type=image) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:56.354566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.356072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.361708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 507/1036] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:56.367750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.378352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.379078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.379277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.379544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.380451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:56.380559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.382030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.404650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 530/1037] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:56.405664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.424234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:56.439062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:56.487077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f1beb7-8bf6-4a22-94b6-a770c4179c9f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.510898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6e49c-0d8a-48b0-b67e-3a3d132559ad None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.523146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.523767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.524043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.524402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.525106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] RBAC: Adding query filter params (interface=public, service_id=2eb52c834a304201bfe477a8636d2340, region_id=RegionOne) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:56.525443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.526788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.532214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 508/1038] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/endpoints?service_id=2eb52c834a304201bfe477a8636d2340&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:56.537424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.551440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.552056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.552455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.552868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.625730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.627214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.637703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6316200-a9f5-4867-ad2c-c2a4dc4d09b3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.647077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:56.663056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:56.674173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.674819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.675133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.675385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.676002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.677376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.684157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 509/1039] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:38:56.745735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 531/1040] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 06:38:56.752103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:56.862270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3448e580-424c-449b-a3c4-63248ff6a33b None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:56.900550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:56.901202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:56.901479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:56.901752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:56.912580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:56.914128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:38:56.929137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:56.930160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:38:56.936032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:38:56.936032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:38:56.936032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:56.936032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 510/1041] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:56.937843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:57.043099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ba69cb-ae18-49e9-b851-09a8bf7eb5ba None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:57.072692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:57.078651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:57.079321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:57.079598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:57.086338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:57.086338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:57.086338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:57.086338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:57.094523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 532/1042] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:38:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:57.100153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:57.125992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:57.204368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59f7ac-0fee-4188-a7f9-e0975e2718d5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:57.240179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095c942-e906-4c75-ab23-4f2cc60a0088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:57.240817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c942-e906-4c75-ab23-4f2cc60a0088 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:57.241099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c942-e906-4c75-ab23-4f2cc60a0088 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:57.241372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095c942-e906-4c75-ab23-4f2cc60a0088 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:57.248293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c942-e906-4c75-ab23-4f2cc60a0088 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:57.249719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095c942-e906-4c75-ab23-4f2cc60a0088 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-b095c942-e906-4c75-ab23-4f2cc60a0088 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:38:57.261206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:57.262192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:38:57.263597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:38:57.266855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 511/1043] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:38:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:57.268557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:57.301637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2bd8e-cf53-478b-b93a-239c6998f1a9 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:57.301944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2bd8e-cf53-478b-b93a-239c6998f1a9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:57.302198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f2bd8e-cf53-478b-b93a-239c6998f1a9 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:57.303774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 512/1044] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:57.309169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f93410-2840-4f05-ba86-819fd27cde40 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:57.309454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f93410-2840-4f05-ba86-819fd27cde40 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:57.309735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f93410-2840-4f05-ba86-819fd27cde40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:57.333844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-38f93410-2840-4f05-ba86-819fd27cde40 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:57.335081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-38f93410-2840-4f05-ba86-819fd27cde40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:57.377453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4172215-d07f-4c03-ad80-3a6d549b0e06 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:57.412351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 513/1045] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:57.418520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:57.419291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:57.419671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:57.420164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:57.420885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:57.421293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:57.422852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:57.436220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 533/1046] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:38:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:57.442361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f93410-2840-4f05-ba86-819fd27cde40 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:57.462705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:57.552554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f93410-2840-4f05-ba86-819fd27cde40 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:57.601337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:57.601950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:57.602254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:57.602677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:57.603303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] RBAC: Adding query filter params (role.id=d9d7e56793ab4546a30f2273fa612371, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=2a68d368b5d14b75aaba3bbb3f4bb62c) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:57.603621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:57.605044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:57.610658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 514/1047] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:57 2022] GET /identity/v3/role_assignments?user.id=2a68d368b5d14b75aaba3bbb3f4bb62c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=d9d7e56793ab4546a30f2273fa612371 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:57.678322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:57.767085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:57.814976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa193ae1-d2ac-4e86-927a-0e72b9c8ab79 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:57.850375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:57.851062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:57.851344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:57.851621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:57.862629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:38:57.868553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:57.869625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:38:57.870565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:57.874803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 534/1048] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:57.875807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:57.960221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:57.982808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48305dfb-e5ba-4cad-9f08-a39620483663 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:58.016891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:58.017501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:58.017786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:58.018064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:58.018733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:58.019067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:58.020427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:58.028739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 515/1049] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:58.034282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:58.134381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d033be-78cf-42b9-88f7-f106a70c19e0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:58.147075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:58.168386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:58.169097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:58.169450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:58.169795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] PATH_INFO: `/v3/users/ef3e813d5cf54deebe27ddcfdbbaac11` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:58.184062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] RBAC: Authorizing `identity:get_user(user_id=ef3e813d5cf54deebe27ddcfdbbaac11)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:58.185588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:58.192040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 535/1050] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:38:58 2022] GET /identity/v3/users/ef3e813d5cf54deebe27ddcfdbbaac11 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:58.193621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:58.347381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1d6556-e84c-4a38-9e9b-230af1630ab6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:58.403390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:58.404392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:58.404857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:58.405352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:58.423978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:58.482381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:58.483859 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:58.583748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 516/1051] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:38:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 06:38:58.589542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:58.702667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb294eda-7153-446b-aea2-e4586ede7418 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:58.751741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69497be8-05d1-4a10-aa93-ed12638e9689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:58.752478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497be8-05d1-4a10-aa93-ed12638e9689 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:58.752823 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497be8-05d1-4a10-aa93-ed12638e9689 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:58.753167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69497be8-05d1-4a10-aa93-ed12638e9689 None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:58.754434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497be8-05d1-4a10-aa93-ed12638e9689 None admin] RBAC: Authorizing `identity:get_project(project_id=b03ab5e9eed34e2db3148170afe0f602)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:58.755981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69497be8-05d1-4a10-aa93-ed12638e9689 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:58.760442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 536/1052] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:38:58 2022] GET /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:58.764372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:58.809328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:58.872326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f676dd6-3483-49e3-ac0a-eb80c6d535b3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:58.909147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f9d4e6-5a44-4374-9ef1-1148016ead34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:58.909759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9d4e6-5a44-4374-9ef1-1148016ead34 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:58.910042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9d4e6-5a44-4374-9ef1-1148016ead34 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:58.910317 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f9d4e6-5a44-4374-9ef1-1148016ead34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:58.911075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9d4e6-5a44-4374-9ef1-1148016ead34 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=b03ab5e9eed34e2db3148170afe0f602, user.id=ef3e813d5cf54deebe27ddcfdbbaac11) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:58.911379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9d4e6-5a44-4374-9ef1-1148016ead34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:58.912786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f9d4e6-5a44-4374-9ef1-1148016ead34 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:58.926809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 517/1053] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:38:58 2022] GET /identity/v3/role_assignments?user.id=ef3e813d5cf54deebe27ddcfdbbaac11&scope.project.id=b03ab5e9eed34e2db3148170afe0f602&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:38:58.958884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c793c-3f27-4c9b-a474-1d6e0b7270f3 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:58.959134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c793c-3f27-4c9b-a474-1d6e0b7270f3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:58.959369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590c793c-3f27-4c9b-a474-1d6e0b7270f3 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:58.960897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 537/1054] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:38:58.967183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66d98-6c70-4d58-8ec6-84058869305f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:58.967514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66d98-6c70-4d58-8ec6-84058869305f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:58.967743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a66d98-6c70-4d58-8ec6-84058869305f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:58.986943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-45a66d98-6c70-4d58-8ec6-84058869305f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:58.988170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-45a66d98-6c70-4d58-8ec6-84058869305f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:59.058360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 518/1055] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:38:59.320571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c793c-3f27-4c9b-a474-1d6e0b7270f3 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:59.365236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:59.427705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590c793c-3f27-4c9b-a474-1d6e0b7270f3 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:59.461406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:59.462058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:59.462335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:59.462601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] PATH_INFO: `/v3/services/image` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:59.463203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:59.464562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:38:59.473074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:38:59.474061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 24 06:38:59.475468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:38:59.479134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 538/1056] 10.222.0.59 () {56 vars in 1105 bytes} [Wed Aug 24 06:38:59 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:38:59.482481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66d98-6c70-4d58-8ec6-84058869305f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:59.516263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:59.582484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a66d98-6c70-4d58-8ec6-84058869305f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:59.615918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe37413-9d5c-474a-98b4-342b78fced61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:59.616561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe37413-9d5c-474a-98b4-342b78fced61 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:59.616791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe37413-9d5c-474a-98b4-342b78fced61 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:59.617064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe37413-9d5c-474a-98b4-342b78fced61 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:59.618207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe37413-9d5c-474a-98b4-342b78fced61 None admin] RBAC: Adding query filter params (name=image) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:59.618512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe37413-9d5c-474a-98b4-342b78fced61 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:59.619889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe37413-9d5c-474a-98b4-342b78fced61 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:59.624829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 519/1057] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:59.630315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:59.701937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843fe3-e4b7-4cc5-ab88-391cfcde4442 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:59.702220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843fe3-e4b7-4cc5-ab88-391cfcde4442 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:59.702502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b843fe3-e4b7-4cc5-ab88-391cfcde4442 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:59.704088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 520/1058] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:38:59.708897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be542-dd5a-45a4-af1f-bb796eda3bf0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:59.709208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be542-dd5a-45a4-af1f-bb796eda3bf0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:59.709458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0be542-dd5a-45a4-af1f-bb796eda3bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:59.730453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1f0be542-dd5a-45a4-af1f-bb796eda3bf0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:38:59.731718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1f0be542-dd5a-45a4-af1f-bb796eda3bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:38:59.750162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7255c4-142a-4d8d-a530-e281939cfb20 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:59.752247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:38:59.791178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:59.791820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:59.792096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:59.792362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:59.792999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] RBAC: Adding query filter params (type=image) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:38:59.793320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:59.794691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:38:59.800186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 539/1059] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:38:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:38:59.805752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:38:59.811338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 521/1060] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:38:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:38:59.936855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e2e6a-a58a-482d-bd4b-5ccc4eab2ca9 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:38:59.982894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:38:59.983521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:38:59.983805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:38:59.984079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] PATH_INFO: `/v3/endpoints` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:38:59.984756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:38:59.986134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:00.070530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 540/1061] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:38:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:39:00.083638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be542-dd5a-45a4-af1f-bb796eda3bf0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:00.116554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:00.197907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0be542-dd5a-45a4-af1f-bb796eda3bf0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:00.241609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:00.242250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:00.242532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:00.242861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:00.253217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:00.257960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:00.259458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:00.260295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 522/1062] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 06:39:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:00.265821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:00.292280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:00.370986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8504a74e-b370-4ca4-a28b-72b5cdae433e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:00.406087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:00.406701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:00.407009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:00.407283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:00.408010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:00.408317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:00.409689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:00.422821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 541/1063] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 06:39:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:00.424145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:00.516372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:00.533251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298e7fb8-64e6-4387-be2a-ba5d0c70517f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:00.569072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:00.569769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:00.570050 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:00.570327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:00.581332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:00.582803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:39:00.598504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:00.599579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:39:00.600477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:39:00.600477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:00.600477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:00.600477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 523/1064] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:00.606538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:00.704235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:00.723704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a68c78-bade-4549-9009-627225b5ad8b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:00.761306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c308d4-0978-4647-8c3d-4995b68603bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:00.761971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c308d4-0978-4647-8c3d-4995b68603bc None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:00.762226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c308d4-0978-4647-8c3d-4995b68603bc None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:00.762466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c308d4-0978-4647-8c3d-4995b68603bc None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:00.763164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c308d4-0978-4647-8c3d-4995b68603bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:00.763502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c308d4-0978-4647-8c3d-4995b68603bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:00.764986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c308d4-0978-4647-8c3d-4995b68603bc None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:00.781615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 542/1065] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:39:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:00.782849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:00.814289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b183f2f-b5df-46fa-a3d5-94d9d8935e1e None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:00.814580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b183f2f-b5df-46fa-a3d5-94d9d8935e1e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:00.814884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b183f2f-b5df-46fa-a3d5-94d9d8935e1e None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:00.816242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 543/1066] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:39:00.821182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fec1f-a253-44ad-a8e6-00050ae410ba None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:00.822129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fec1f-a253-44ad-a8e6-00050ae410ba None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:00.822129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27fec1f-a253-44ad-a8e6-00050ae410ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:00.839728 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c27fec1f-a253-44ad-a8e6-00050ae410ba None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:00.840928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c27fec1f-a253-44ad-a8e6-00050ae410ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:00.892552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85685d62-6592-4aa0-a9ef-431fb572bc62 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:00.911282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 544/1067] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:39:00.927772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:00.928179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:00.928464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:00.928741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] PATH_INFO: `/v3/users/nova` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:00.932113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:00.937890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:00.939409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:39:00.950936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:00.956778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:00.957805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 524/1068] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:39:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:00.958392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fec1f-a253-44ad-a8e6-00050ae410ba None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.037393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:01.064640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27fec1f-a253-44ad-a8e6-00050ae410ba None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.104132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.104756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.105037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.105307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.106040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:01.106345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.107881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.131730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 545/1069] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:39:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:01.133137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.175956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.241440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e28845-a5a8-4e4e-b2d7-9244ea8f871c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.280733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.281368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.281651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.282031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.288339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298af1a4-6b6a-4be0-a958-472d83ecde2a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.294002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.295472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:39:01.310010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:01.311038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:39:01.311975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:39:01.311975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:01.311975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:01.311975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 525/1070] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:01.316856 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.320678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:01.325761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.326395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.326676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.326990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.337677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:01.342519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:01.343622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:01.347724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 546/1071] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:39:01.349529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.373553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:01.426715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4620d1e0-5a4a-4fc0-bd2d-acbd64959ed6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.454431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093e04f-6dbd-467d-99c8-a349f38ebdec None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.462300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.462960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.463246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.463524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.464180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:01.464484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.466446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.480553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 526/1072] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:01.486422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.498232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.498873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.499153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.499425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.500084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:01.500407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.501735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.511840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 547/1073] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:01.517239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.574531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:01.594323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7780db19-4fa3-4c02-b31b-44baaec0e616 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.604130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:01.621634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a701e8b-aa42-4de6-bef7-f761d913e070 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.631810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.632758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.633716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.634000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.640852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.642294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:39:01.654268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:01.655241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:01.656166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 527/1074] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:39:01.658563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b74ba-a658-4487-824f-634835527f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.659246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b74ba-a658-4487-824f-634835527f5f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.659530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b74ba-a658-4487-824f-634835527f5f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.659808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967b74ba-a658-4487-824f-634835527f5f None admin] PATH_INFO: `/v3/users/ef3e813d5cf54deebe27ddcfdbbaac11` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.660971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b74ba-a658-4487-824f-634835527f5f None admin] RBAC: Authorizing `identity:get_user(user_id=ef3e813d5cf54deebe27ddcfdbbaac11)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.661144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.662447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967b74ba-a658-4487-824f-634835527f5f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.664188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 548/1075] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/users/ef3e813d5cf54deebe27ddcfdbbaac11 => generated 285 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:01.670293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b74ba-a658-4487-824f-634835527f5f None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.777438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3990b-a124-472c-b045-29999d0ecf9f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.787581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967b74ba-a658-4487-824f-634835527f5f None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.811556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:01.818834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.820005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.820005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.820378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.820789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:01.821091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.822541 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.824882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.825938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.826224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.826508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.827682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] RBAC: Authorizing `identity:get_project(project_id=b03ab5e9eed34e2db3148170afe0f602)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.829109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.831542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 549/1076] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602 => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:01.842342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.842544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 528/1077] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:39:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:01.844083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:01.878472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:01.953373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7673e6e-dfec-4d51-b0a7-6f0066434796 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.958423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab252690-793d-4ec7-87e3-7036aba20e62 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:01.990138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a3843-e0d0-4b6b-a0a0-ecb5249b31d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.990834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3843-e0d0-4b6b-a0a0-ecb5249b31d6 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.991123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3843-e0d0-4b6b-a0a0-ecb5249b31d6 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.991408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a3843-e0d0-4b6b-a0a0-ecb5249b31d6 None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602/users/ef3e813d5cf54deebe27ddcfdbbaac11/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:01.993393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a3843-e0d0-4b6b-a0a0-ecb5249b31d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b03ab5e9eed34e2db3148170afe0f602, user_id=ef3e813d5cf54deebe27ddcfdbbaac11, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:01.994865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a3843-e0d0-4b6b-a0a0-ecb5249b31d6 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:01.996630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:01.997304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:01.997588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:01.998225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/2a68d368b5d14b75aaba3bbb3f4bb62c/roles/d9d7e56793ab4546a30f2273fa612371` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:02.000148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=2a68d368b5d14b75aaba3bbb3f4bb62c, role_id=d9d7e56793ab4546a30f2273fa612371)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:02.001570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:02.075099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 550/1078] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:39:01 2022] PUT /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602/users/ef3e813d5cf54deebe27ddcfdbbaac11/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:39:02.076258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654e40-1cbd-4be7-9ffa-b03744069429 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:02.076541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654e40-1cbd-4be7-9ffa-b03744069429 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:02.076816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c654e40-1cbd-4be7-9ffa-b03744069429 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:02.078059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 551/1079] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:02.083815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23f45-38ca-47fe-9e7b-c3b21638a631 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:02.084096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23f45-38ca-47fe-9e7b-c3b21638a631 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:02.084369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b23f45-38ca-47fe-9e7b-c3b21638a631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:02.105011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-47b23f45-38ca-47fe-9e7b-c3b21638a631 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:02.107268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-47b23f45-38ca-47fe-9e7b-c3b21638a631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:02.112340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 529/1080] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:39:01 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/2a68d368b5d14b75aaba3bbb3f4bb62c/roles/d9d7e56793ab4546a30f2273fa612371 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:39:02.173916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:02.203632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 552/1081] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:39:02.466820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:02.558282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:02.570296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b590666a-c7e3-4cd4-a425-0b57e7305be9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:02.606549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:02.607193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:02.607475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:02.607745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:02.676802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:02.678243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:02.773281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:02.790818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 530/1082] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:02.792836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b23f45-38ca-47fe-9e7b-c3b21638a631 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:02.894818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b23f45-38ca-47fe-9e7b-c3b21638a631 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:02.929008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c51302-b9b6-4892-9acf-dc6c924a68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:02.929640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c51302-b9b6-4892-9acf-dc6c924a68c7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:02.929974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c51302-b9b6-4892-9acf-dc6c924a68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:02.930754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c51302-b9b6-4892-9acf-dc6c924a68c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:02.941277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c51302-b9b6-4892-9acf-dc6c924a68c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:02.942730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c51302-b9b6-4892-9acf-dc6c924a68c7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b1c51302-b9b6-4892-9acf-dc6c924a68c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:39:02.960861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:02.961979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:39:02.963342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:39:02.963342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:02.963342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:02.963809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 553/1083] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:02.968061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:03.076483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb5693-1cbd-4695-9603-ab9c1dfcb89d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:03.111938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c17526-7638-49b1-846b-9b89edce75e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:03.112558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17526-7638-49b1-846b-9b89edce75e6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:03.112840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17526-7638-49b1-846b-9b89edce75e6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:03.113116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c17526-7638-49b1-846b-9b89edce75e6 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:03.113773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17526-7638-49b1-846b-9b89edce75e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:03.114080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17526-7638-49b1-846b-9b89edce75e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:03.115485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c17526-7638-49b1-846b-9b89edce75e6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:03.127682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 531/1084] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:04.033063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c0739-e3f1-4be2-ad13-0c95f150a5c7 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.033569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c0739-e3f1-4be2-ad13-0c95f150a5c7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.033747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465c0739-e3f1-4be2-ad13-0c95f150a5c7 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.035260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 554/1085] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:04.040921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8dbb8-3a26-48f2-b135-42791d363ccb None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.041330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8dbb8-3a26-48f2-b135-42791d363ccb None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.041478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8dbb8-3a26-48f2-b135-42791d363ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.059606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-52b8dbb8-3a26-48f2-b135-42791d363ccb None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:04.060773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-52b8dbb8-3a26-48f2-b135-42791d363ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:04.084371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dc72a-bfc3-44f3-b520-de813103f8a0 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.084661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dc72a-bfc3-44f3-b520-de813103f8a0 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.084951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dc72a-bfc3-44f3-b520-de813103f8a0 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.086519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 555/1086] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:39:04.091500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c53e80-d2f8-4ad5-9547-44f5639fd389 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.091794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c53e80-d2f8-4ad5-9547-44f5639fd389 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.092070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c53e80-d2f8-4ad5-9547-44f5639fd389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.104368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:04.109785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-70c53e80-d2f8-4ad5-9547-44f5639fd389 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:04.111035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-70c53e80-d2f8-4ad5-9547-44f5639fd389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:04.127802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 532/1087] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:04.140970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:04.181498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 556/1088] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:39:04.394647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8dbb8-3a26-48f2-b135-42791d363ccb None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.455560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c53e80-d2f8-4ad5-9547-44f5639fd389 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.491482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8dbb8-3a26-48f2-b135-42791d363ccb None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:04.526571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:04.527234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.527513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.527785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.538087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:04.543271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:04.544580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:04.545657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 533/1089] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:04.550471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.557926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c53e80-d2f8-4ad5-9547-44f5639fd389 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:04.593708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:04.593925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77635724-1489-49da-b03c-d202f0088981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:04.594548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77635724-1489-49da-b03c-d202f0088981 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.594858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77635724-1489-49da-b03c-d202f0088981 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.595141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77635724-1489-49da-b03c-d202f0088981 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.612799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77635724-1489-49da-b03c-d202f0088981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-77635724-1489-49da-b03c-d202f0088981 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:04.617580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:04.619555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:04.621201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 557/1090] 10.222.0.59 () {56 vars in 1120 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:39:04.626841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77635724-1489-49da-b03c-d202f0088981 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.655760 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:04.657654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65605245-ace3-4a8a-b917-62e8e662fdeb None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:04.701581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:04.702319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.702670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.702986 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.703837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:04.704150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:04.705944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:04.717397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 534/1091] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:04.723083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.736744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77635724-1489-49da-b03c-d202f0088981 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:04.771477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:04.772114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.772402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.772678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.773349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:04.774252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:04.775653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:04.783612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 558/1092] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:04.789264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.819942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:04.824045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d75e324-620c-4ae6-a2d4-d331524b30c5 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:04.856677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:04.857305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.857582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.857857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] PATH_INFO: `/v3/users/ef3e813d5cf54deebe27ddcfdbbaac11` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.859023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] RBAC: Authorizing `identity:get_user(user_id=ef3e813d5cf54deebe27ddcfdbbaac11)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:04.860442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:04.862089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 535/1093] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/users/ef3e813d5cf54deebe27ddcfdbbaac11 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:04.868355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.872624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:04.888931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1549e491-4084-4424-8e09-a47eed96f452 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:04.922963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:04.923508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:04.923784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:04.924052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:04.934300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:04.935937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:39:04.950649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:04.951714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:39:04.952618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:39:04.952618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:04.952618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:04.952618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 559/1094] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:39:04.957761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:04.970551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e72641-bf79-4ac1-8ea2-e3009e733187 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.004940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.005546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.005830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.006111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.040945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:05.057024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d564649-cb15-4c8f-b699-4cfe540f24a8 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.072935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.074427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.091245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.091852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.092138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.092421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.093073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:05.093378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.094746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.097077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:05.106599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 560/1095] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:05.112443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:05.172857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 536/1096] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 06:39:05.178393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:05.212633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0913a4-12c2-47a8-b997-db3ad762d0da None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.243191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:05.247944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.248573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.248855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.249131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.256295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.257754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:39:05.269311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:05.275663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:05.276902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 561/1097] 10.222.0.59 () {56 vars in 1093 bytes} [Wed Aug 24 06:39:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:39:05.277503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eca1f22-d718-4ea0-a69d-12b8728452f6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.277580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:05.313827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.314446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.314727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.315028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.316143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] RBAC: Authorizing `identity:get_project(project_id=b03ab5e9eed34e2db3148170afe0f602)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.317609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.319266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 537/1098] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:05 2022] GET /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:05.326191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:05.337561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:05.389742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b176cfe-e259-49fb-a53b-ca10443d79a4 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.423705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.424541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.424877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.425160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.425910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:05.426215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.427701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.434834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc681b8-8fbf-4dfd-9bf5-9eb5e2a97606 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.445434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 562/1099] 10.222.0.59 () {56 vars in 1133 bytes} [Wed Aug 24 06:39:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:05.451310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:05.469545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.470159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.470437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.470714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.471571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=b03ab5e9eed34e2db3148170afe0f602, user.id=ef3e813d5cf54deebe27ddcfdbbaac11) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:05.471885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.473455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.477307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:05.480647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 538/1100] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:05 2022] GET /identity/v3/role_assignments?user.id=ef3e813d5cf54deebe27ddcfdbbaac11&scope.project.id=b03ab5e9eed34e2db3148170afe0f602&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:05.558588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a0150b-fe94-4694-8d89-1fdfdb0da4f7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.574356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:05.595568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.596183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.596465 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.596744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.669801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.671459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.770899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 563/1101] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 24 06:39:05.777304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:05.891250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1916339-f518-4ecc-bc68-f48d79fcc4ca None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:05.926054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:05.926688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:05.926999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:05.927277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:05.937528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:05.938995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:39:05.953372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:05.954609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:39:05.955649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:39:05.955649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:39:05.955649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:05.955649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 539/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:05.960177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:05.977979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:06.060282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18630-fec9-4c15-94b7-787562a04706 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:06.093744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:06.094332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:06.094613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:06.094917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:06.095550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:06.095850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:06.097209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:06.108933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 564/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:39:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:06.114296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:06.167038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:06.214038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb538be0-143e-4149-a079-b861b714cd93 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:06.245914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:06.246470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:06.246751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:06.247060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:06.253408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:06.254859 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:39:06.266180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:06.267205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:06.268153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 540/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:39:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:06.273201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:06.346201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:06.369798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee725433-feae-4125-9919-a9ae3a038fb2 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:06.402853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b6e1e7-30d5-4ddc-9d89-0213319d498f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:06.403453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e1e7-30d5-4ddc-9d89-0213319d498f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:06.403730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e1e7-30d5-4ddc-9d89-0213319d498f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:06.404003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b6e1e7-30d5-4ddc-9d89-0213319d498f None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:06.404690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6e1e7-30d5-4ddc-9d89-0213319d498f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:06.404993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6e1e7-30d5-4ddc-9d89-0213319d498f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:06.406406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b6e1e7-30d5-4ddc-9d89-0213319d498f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:06.418340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 565/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:39:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:06.424348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:06.524001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e29d15-3ec8-44c9-ae34-fc86fc01326d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:06.536715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:06.557922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e024f06-0234-47fb-a692-6bda8f5dff5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:06.558628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e024f06-0234-47fb-a692-6bda8f5dff5f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:06.558947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e024f06-0234-47fb-a692-6bda8f5dff5f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:06.559216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e024f06-0234-47fb-a692-6bda8f5dff5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:06.560016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e024f06-0234-47fb-a692-6bda8f5dff5f None admin] RBAC: Adding query filter params (role.id=d9d7e56793ab4546a30f2273fa612371, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=2a68d368b5d14b75aaba3bbb3f4bb62c) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:06.560327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e024f06-0234-47fb-a692-6bda8f5dff5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:06.561750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e024f06-0234-47fb-a692-6bda8f5dff5f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:06.567959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 541/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:06 2022] GET /identity/v3/role_assignments?user.id=2a68d368b5d14b75aaba3bbb3f4bb62c&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=d9d7e56793ab4546a30f2273fa612371 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:07.434875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df9ec-fe0c-4ccf-a0ca-c28d8c81fe5a None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:07.435420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df9ec-fe0c-4ccf-a0ca-c28d8c81fe5a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:07.435515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181df9ec-fe0c-4ccf-a0ca-c28d8c81fe5a None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:07.436788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 566/1107] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:07.441937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537125f-be5f-45a2-a5cf-1dbf9d086bac None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:07.442334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537125f-be5f-45a2-a5cf-1dbf9d086bac None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:07.442486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0537125f-be5f-45a2-a5cf-1dbf9d086bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:07.460623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0537125f-be5f-45a2-a5cf-1dbf9d086bac None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:07.462438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0537125f-be5f-45a2-a5cf-1dbf9d086bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:07.526846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 542/1108] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:07.799503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df9ec-fe0c-4ccf-a0ca-c28d8c81fe5a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:07.900753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181df9ec-fe0c-4ccf-a0ca-c28d8c81fe5a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:07.935498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8d8de5-3a06-45ae-90da-b1b559a49200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:07.936131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8de5-3a06-45ae-90da-b1b559a49200 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:07.936416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8de5-3a06-45ae-90da-b1b559a49200 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:07.936692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8d8de5-3a06-45ae-90da-b1b559a49200 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:07.937817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d8de5-3a06-45ae-90da-b1b559a49200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:07.939316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8d8de5-3a06-45ae-90da-b1b559a49200 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:07.940876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 567/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:39:07.947433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537125f-be5f-45a2-a5cf-1dbf9d086bac None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:08.044139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0537125f-be5f-45a2-a5cf-1dbf9d086bac None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:08.051667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:08.080385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4a96f1-c01c-4002-9e17-bfe3ccc90ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:08.080991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a96f1-c01c-4002-9e17-bfe3ccc90ba9 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:08.081276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a96f1-c01c-4002-9e17-bfe3ccc90ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:08.081554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4a96f1-c01c-4002-9e17-bfe3ccc90ba9 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:08.082212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a96f1-c01c-4002-9e17-bfe3ccc90ba9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:08.083704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4a96f1-c01c-4002-9e17-bfe3ccc90ba9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:08.195205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 543/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:39:07 2022] POST /identity/v3/users => generated 286 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:39:10.170275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ad85-7935-4948-98e3-3fac8c4f62da None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:10.171622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ad85-7935-4948-98e3-3fac8c4f62da None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:10.172116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd4ad85-7935-4948-98e3-3fac8c4f62da None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:10.175233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 568/1111] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:10.181647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70e1e-3703-44fd-9b35-bc3e464a38a7 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:10.182152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70e1e-3703-44fd-9b35-bc3e464a38a7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:10.182284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a70e1e-3703-44fd-9b35-bc3e464a38a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:10.201097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e0a70e1e-3703-44fd-9b35-bc3e464a38a7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:10.202280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e0a70e1e-3703-44fd-9b35-bc3e464a38a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:10.266359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 544/1112] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 24 06:39:10.534488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4ad85-7935-4948-98e3-3fac8c4f62da None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:10.537427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:10.636226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd4ad85-7935-4948-98e3-3fac8c4f62da None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:10.669594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:10.670218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:10.670496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:10.670865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] PATH_INFO: `/v3/roles/91979b0781874aef81daab5791316f61` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:10.672170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] RBAC: Authorizing `identity:get_role(role_id=91979b0781874aef81daab5791316f61)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:10.673544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:10.674883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 569/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:10 2022] GET /identity/v3/roles/91979b0781874aef81daab5791316f61 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:10.680955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a70e1e-3703-44fd-9b35-bc3e464a38a7 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:10.768733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:10.777717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a70e1e-3703-44fd-9b35-bc3e464a38a7 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:10.811259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:10.811820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:10.812101 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:10.812375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] PATH_INFO: `/v3/users/c033abced53241c4bfbee0db53daabc0` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:10.826223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] RBAC: Authorizing `identity:get_user(user_id=c033abced53241c4bfbee0db53daabc0)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:10.827680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:10.829257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 545/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:10 2022] GET /identity/v3/users/c033abced53241c4bfbee0db53daabc0 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:10.835143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:10.903771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:10.933922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b664edb-4cd3-4458-a05d-61ef12104d16 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:10.967000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:10.967937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:10.967937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:10.968228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:11.032084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:11.033524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:11.098094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:11.128719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 570/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:11.135321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:11.231467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa0831c-8885-4e18-a2b2-6ddb76a2f5dd None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:11.264177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74be7e71-0c8a-433b-88ef-fb246d433897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:11.264802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be7e71-0c8a-433b-88ef-fb246d433897 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:11.265079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be7e71-0c8a-433b-88ef-fb246d433897 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:11.265348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be7e71-0c8a-433b-88ef-fb246d433897 None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:11.266445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be7e71-0c8a-433b-88ef-fb246d433897 None admin] RBAC: Authorizing `identity:get_project(project_id=b03ab5e9eed34e2db3148170afe0f602)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:11.267955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74be7e71-0c8a-433b-88ef-fb246d433897 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:11.269549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 546/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:11 2022] GET /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:11.275796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:11.373929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e56998-b203-45c4-97ee-b157da1c2c25 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:11.405575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8504d-d2b9-4fcd-be74-0db0a5af7705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:11.406163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8504d-d2b9-4fcd-be74-0db0a5af7705 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:11.406437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8504d-d2b9-4fcd-be74-0db0a5af7705 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:11.406703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8504d-d2b9-4fcd-be74-0db0a5af7705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:11.407457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8504d-d2b9-4fcd-be74-0db0a5af7705 None admin] RBAC: Adding query filter params (role.id=91979b0781874aef81daab5791316f61, scope.project.id=b03ab5e9eed34e2db3148170afe0f602, user.id=c033abced53241c4bfbee0db53daabc0) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:11.407761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8504d-d2b9-4fcd-be74-0db0a5af7705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:11.409168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8504d-d2b9-4fcd-be74-0db0a5af7705 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:11.415079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 571/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:11 2022] GET /identity/v3/role_assignments?user.id=c033abced53241c4bfbee0db53daabc0&scope.project.id=b03ab5e9eed34e2db3148170afe0f602&role.id=91979b0781874aef81daab5791316f61 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:13.302239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b37a-43db-4136-ab95-d18fb979a933 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:13.302791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b37a-43db-4136-ab95-d18fb979a933 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:13.302902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b37a-43db-4136-ab95-d18fb979a933 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:13.304918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 547/1118] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:13.310180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89d44-774a-41ec-9afe-f2dbf03daae2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:13.310578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89d44-774a-41ec-9afe-f2dbf03daae2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:13.310733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b89d44-774a-41ec-9afe-f2dbf03daae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:13.328806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c3b89d44-774a-41ec-9afe-f2dbf03daae2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:13.329997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c3b89d44-774a-41ec-9afe-f2dbf03daae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:13.355329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:13.394574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 572/1119] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:13.660348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094b37a-43db-4136-ab95-d18fb979a933 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:13.680048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:13.761362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094b37a-43db-4136-ab95-d18fb979a933 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:13.793595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:13.794220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:13.794496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:13.794787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] PATH_INFO: `/v3/roles/91979b0781874aef81daab5791316f61` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:13.796161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] RBAC: Authorizing `identity:get_role(role_id=91979b0781874aef81daab5791316f61)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:13.797513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:13.798840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 548/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:13 2022] GET /identity/v3/roles/91979b0781874aef81daab5791316f61 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:13.805398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89d44-774a-41ec-9afe-f2dbf03daae2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:13.904375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b89d44-774a-41ec-9afe-f2dbf03daae2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:13.938567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:13.939139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:13.939419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:13.939693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] PATH_INFO: `/v3/users/c033abced53241c4bfbee0db53daabc0` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:13.940812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] RBAC: Authorizing `identity:get_user(user_id=c033abced53241c4bfbee0db53daabc0)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:13.942268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:13.943876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 573/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:13 2022] GET /identity/v3/users/c033abced53241c4bfbee0db53daabc0 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:13.949996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:14.035930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:14.053220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2e26-124f-480b-8677-c07e8efaaacc None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:14.087266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1bec63-074e-4050-841e-d4dd6c05611f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:14.087898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bec63-074e-4050-841e-d4dd6c05611f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:14.088185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bec63-074e-4050-841e-d4dd6c05611f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:14.088460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1bec63-074e-4050-841e-d4dd6c05611f None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:14.089605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bec63-074e-4050-841e-d4dd6c05611f None admin] RBAC: Authorizing `identity:get_project(project_id=b03ab5e9eed34e2db3148170afe0f602)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:14.091069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1bec63-074e-4050-841e-d4dd6c05611f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:14.092725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 549/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:13 2022] GET /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:14.098818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:14.130064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:14.206633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e7c27-5b77-44de-bf83-09dc85d11501 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:14.239456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ab4964-f287-4642-9ff8-48b8ff55596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:14.240104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab4964-f287-4642-9ff8-48b8ff55596f None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:14.240383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab4964-f287-4642-9ff8-48b8ff55596f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:14.240657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ab4964-f287-4642-9ff8-48b8ff55596f None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602/users/c033abced53241c4bfbee0db53daabc0/roles/91979b0781874aef81daab5791316f61` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:14.242796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab4964-f287-4642-9ff8-48b8ff55596f None admin] RBAC: Authorizing `identity:create_grant(project_id=b03ab5e9eed34e2db3148170afe0f602, user_id=c033abced53241c4bfbee0db53daabc0, role_id=91979b0781874aef81daab5791316f61)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:14.244228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ab4964-f287-4642-9ff8-48b8ff55596f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:14.312983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 574/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:39:14 2022] PUT /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602/users/c033abced53241c4bfbee0db53daabc0/roles/91979b0781874aef81daab5791316f61 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:39:16.193852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c4e44-9e5a-469c-9921-673c83bf0e4c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:16.194382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c4e44-9e5a-469c-9921-673c83bf0e4c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:16.194382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2c4e44-9e5a-469c-9921-673c83bf0e4c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:16.195808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 550/1124] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:16.201172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567af887-4dd2-4a33-9d4d-78242af18333 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:16.201587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567af887-4dd2-4a33-9d4d-78242af18333 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:16.201734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567af887-4dd2-4a33-9d4d-78242af18333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:16.220110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-567af887-4dd2-4a33-9d4d-78242af18333 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:16.221308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-567af887-4dd2-4a33-9d4d-78242af18333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:16.291655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 575/1125] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:16.563491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c4e44-9e5a-469c-9921-673c83bf0e4c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:16.664940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2c4e44-9e5a-469c-9921-673c83bf0e4c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:16.702583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:16.703236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:16.703521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:16.703802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] PATH_INFO: `/v3/roles/91979b0781874aef81daab5791316f61` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:16.705212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] RBAC: Authorizing `identity:get_role(role_id=91979b0781874aef81daab5791316f61)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:16.706595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:16.707960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 551/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:16 2022] GET /identity/v3/roles/91979b0781874aef81daab5791316f61 => generated 223 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:16.714698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567af887-4dd2-4a33-9d4d-78242af18333 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:16.738199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:16.813402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567af887-4dd2-4a33-9d4d-78242af18333 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:16.848185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:16.848742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:16.849026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:16.849302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] PATH_INFO: `/v3/users/c033abced53241c4bfbee0db53daabc0` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:16.850427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] RBAC: Authorizing `identity:get_user(user_id=c033abced53241c4bfbee0db53daabc0)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:16.851898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:16.853508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 576/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:16 2022] GET /identity/v3/users/c033abced53241c4bfbee0db53daabc0 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:16.859595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:16.884295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:16.958812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4667b1-e16d-4207-9015-528c656bcef7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:16.991019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:16.992138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:16.992419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:16.992692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:17.057252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:17.058690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:17.081789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:17.153800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 552/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:17.159886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:17.248197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:17.257557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08073f95-41aa-487d-a31e-db7ece89fdb5 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:17.291449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30d3c3d-de00-4b6f-b9d9-95ba26dbd2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:17.292072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c3d-de00-4b6f-b9d9-95ba26dbd2ea None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:17.292354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c3d-de00-4b6f-b9d9-95ba26dbd2ea None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:17.292625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30d3c3d-de00-4b6f-b9d9-95ba26dbd2ea None admin] PATH_INFO: `/v3/projects/b03ab5e9eed34e2db3148170afe0f602` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:17.293733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3c3d-de00-4b6f-b9d9-95ba26dbd2ea None admin] RBAC: Authorizing `identity:get_project(project_id=b03ab5e9eed34e2db3148170afe0f602)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:17.295183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30d3c3d-de00-4b6f-b9d9-95ba26dbd2ea None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:17.296793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 577/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:17 2022] GET /identity/v3/projects/b03ab5e9eed34e2db3148170afe0f602 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:17.303196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:17.397382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b1e34-0a11-44f7-a639-87c591600cb9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:17.419420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:17.430816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff64b1-70ec-431e-912a-fbf0d7114f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:17.431409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff64b1-70ec-431e-912a-fbf0d7114f8c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:17.431687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff64b1-70ec-431e-912a-fbf0d7114f8c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:17.431960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff64b1-70ec-431e-912a-fbf0d7114f8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:17.432674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff64b1-70ec-431e-912a-fbf0d7114f8c None admin] RBAC: Adding query filter params (role.id=91979b0781874aef81daab5791316f61, scope.project.id=b03ab5e9eed34e2db3148170afe0f602, user.id=c033abced53241c4bfbee0db53daabc0) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:17.432977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff64b1-70ec-431e-912a-fbf0d7114f8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:17.434389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff64b1-70ec-431e-912a-fbf0d7114f8c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:17.439948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 553/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:17 2022] GET /identity/v3/role_assignments?user.id=c033abced53241c4bfbee0db53daabc0&scope.project.id=b03ab5e9eed34e2db3148170afe0f602&role.id=91979b0781874aef81daab5791316f61 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:19.360031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e2f1-7608-4883-880b-838838d2b3b9 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:19.360597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e2f1-7608-4883-880b-838838d2b3b9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:19.360597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a1e2f1-7608-4883-880b-838838d2b3b9 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:19.361920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 578/1131] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:19.367649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a59ab-894b-486f-b8a5-fd56885516b0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:19.368056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a59ab-894b-486f-b8a5-fd56885516b0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:19.368259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9a59ab-894b-486f-b8a5-fd56885516b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:19.386448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8c9a59ab-894b-486f-b8a5-fd56885516b0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:19.387671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8c9a59ab-894b-486f-b8a5-fd56885516b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:19.456631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 554/1132] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:19.723805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1e2f1-7608-4883-880b-838838d2b3b9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:19.826268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a1e2f1-7608-4883-880b-838838d2b3b9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:19.861265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e78573-9c14-4312-9245-c8b1bd650bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:19.861894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78573-9c14-4312-9245-c8b1bd650bb9 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:19.862178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78573-9c14-4312-9245-c8b1bd650bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:19.862454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e78573-9c14-4312-9245-c8b1bd650bb9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:19.863670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e78573-9c14-4312-9245-c8b1bd650bb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:19.865107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e78573-9c14-4312-9245-c8b1bd650bb9 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:19.866858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 579/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:19.872692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a59ab-894b-486f-b8a5-fd56885516b0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:19.978180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9a59ab-894b-486f-b8a5-fd56885516b0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:19.995226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:20.013328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a645c-551d-4f94-a6cf-4f7259d893b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:20.013945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a645c-551d-4f94-a6cf-4f7259d893b9 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:20.014232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a645c-551d-4f94-a6cf-4f7259d893b9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:20.014511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a645c-551d-4f94-a6cf-4f7259d893b9 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:20.015256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a645c-551d-4f94-a6cf-4f7259d893b9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:20.016695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a645c-551d-4f94-a6cf-4f7259d893b9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:20.098161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 555/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:39:19 2022] POST /identity/v3/projects => generated 311 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:39:22.040130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaeaee-5a7a-434b-a012-ac8dd4fc5a23 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:22.040666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaeaee-5a7a-434b-a012-ac8dd4fc5a23 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:22.040666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9aaeaee-5a7a-434b-a012-ac8dd4fc5a23 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:22.042009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 580/1135] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:22.047595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e89f-c38f-4e69-b151-9e70e254f2ca None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:22.048031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e89f-c38f-4e69-b151-9e70e254f2ca None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:22.048203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7e89f-c38f-4e69-b151-9e70e254f2ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:22.066401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-48f7e89f-c38f-4e69-b151-9e70e254f2ca None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:22.067610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-48f7e89f-c38f-4e69-b151-9e70e254f2ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:22.131434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 556/1136] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:22.404484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaeaee-5a7a-434b-a012-ac8dd4fc5a23 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:22.431919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:22.503401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9aaeaee-5a7a-434b-a012-ac8dd4fc5a23 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:22.536196 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652cde7b-510c-4559-83a5-5beae0d7163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:22.536806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cde7b-510c-4559-83a5-5beae0d7163e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:22.537084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cde7b-510c-4559-83a5-5beae0d7163e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:22.537355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652cde7b-510c-4559-83a5-5beae0d7163e None admin] PATH_INFO: `/v3/domains/default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:22.538459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cde7b-510c-4559-83a5-5beae0d7163e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:22.540185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652cde7b-510c-4559-83a5-5beae0d7163e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:22.541732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 581/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:39:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:22.547722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e89f-c38f-4e69-b151-9e70e254f2ca None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:22.639993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:22.643583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7e89f-c38f-4e69-b151-9e70e254f2ca None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:22.681005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81926f3-435f-47ac-831e-3259303f7e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:22.681543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81926f3-435f-47ac-831e-3259303f7e30 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:22.681833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81926f3-435f-47ac-831e-3259303f7e30 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:22.682112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81926f3-435f-47ac-831e-3259303f7e30 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:22.682870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81926f3-435f-47ac-831e-3259303f7e30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:22.684373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81926f3-435f-47ac-831e-3259303f7e30 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:22.799510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 557/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:39:22 2022] POST /identity/v3/users => generated 286 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:39:24.716285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983527-4f77-4f07-98fb-c796e2c8cf1b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:24.716661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983527-4f77-4f07-98fb-c796e2c8cf1b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:24.716835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52983527-4f77-4f07-98fb-c796e2c8cf1b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:24.718184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 582/1139] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:24.724023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cd79-979a-4f12-8646-09ee1c904bdc None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:24.724521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cd79-979a-4f12-8646-09ee1c904bdc None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:24.724659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7cd79-979a-4f12-8646-09ee1c904bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:24.743261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-76e7cd79-979a-4f12-8646-09ee1c904bdc None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:24.744478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-76e7cd79-979a-4f12-8646-09ee1c904bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:24.809683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 558/1140] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:25.080134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52983527-4f77-4f07-98fb-c796e2c8cf1b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:25.172486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:25.179979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52983527-4f77-4f07-98fb-c796e2c8cf1b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:25.213745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:25.214398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:25.214699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:25.215006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:25.225614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:25.230318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:25.231492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:25.232555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 583/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:25.237480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7cd79-979a-4f12-8646-09ee1c904bdc None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:25.318636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:25.333954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7cd79-979a-4f12-8646-09ee1c904bdc None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:25.384335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:25.384936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:25.385215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:25.385488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:25.386146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:25.386448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:25.387828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:25.395606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 559/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:25.401929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:25.497485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24a0291-4b92-40ae-ab7c-b72c10a24ce0 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:25.530388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:25.531032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:25.531316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:25.531590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] PATH_INFO: `/v3/users/164cd24d73924d96b8ad017ed2dd9e2c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:25.544710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] RBAC: Authorizing `identity:get_user(user_id=164cd24d73924d96b8ad017ed2dd9e2c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:25.546152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:25.547785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 584/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:25 2022] GET /identity/v3/users/164cd24d73924d96b8ad017ed2dd9e2c => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:25.553783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:25.651435 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb0b9c-9c5e-43a2-864f-f3e92c7124f9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:25.688041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:25.688637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:25.688912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:25.689185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:25.705436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:25.755667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:25.757628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:25.854284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 560/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:25.860421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:25.875397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:25.961773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a5917-5178-4d24-aa12-2d10d8865ce7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:25.994454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cb459f-2ccb-465a-b0ec-04ca3501f83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:25.995098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb459f-2ccb-465a-b0ec-04ca3501f83c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:25.995379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb459f-2ccb-465a-b0ec-04ca3501f83c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:25.995654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cb459f-2ccb-465a-b0ec-04ca3501f83c None admin] PATH_INFO: `/v3/projects/213df2d7e8384c3a97b125b54277cf93` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:25.996771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb459f-2ccb-465a-b0ec-04ca3501f83c None admin] RBAC: Authorizing `identity:get_project(project_id=213df2d7e8384c3a97b125b54277cf93)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:25.998197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cb459f-2ccb-465a-b0ec-04ca3501f83c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:25.999810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 585/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:25 2022] GET /identity/v3/projects/213df2d7e8384c3a97b125b54277cf93 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:26.006563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:26.050585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:26.102452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f9cc9f-3040-438b-a612-5d8e95759106 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:26.135905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2d8ff-366e-4419-90b6-5eedd95c6346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:26.136937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2d8ff-366e-4419-90b6-5eedd95c6346 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:26.137454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2d8ff-366e-4419-90b6-5eedd95c6346 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:26.137749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2d8ff-366e-4419-90b6-5eedd95c6346 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:26.138479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2d8ff-366e-4419-90b6-5eedd95c6346 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=213df2d7e8384c3a97b125b54277cf93, user.id=164cd24d73924d96b8ad017ed2dd9e2c) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:26.138816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2d8ff-366e-4419-90b6-5eedd95c6346 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:26.140238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2d8ff-366e-4419-90b6-5eedd95c6346 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:26.145438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 561/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:26 2022] GET /identity/v3/role_assignments?user.id=164cd24d73924d96b8ad017ed2dd9e2c&scope.project.id=213df2d7e8384c3a97b125b54277cf93&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:28.011121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a4f0-19a9-4f3f-b88a-50597db5f518 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:28.011650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a4f0-19a9-4f3f-b88a-50597db5f518 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:28.011650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb11a4f0-19a9-4f3f-b88a-50597db5f518 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:28.012945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 586/1147] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:28.017962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1861-fe74-413b-b414-6e1853541671 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:28.018376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1861-fe74-413b-b414-6e1853541671 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:28.018538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bc1861-fe74-413b-b414-6e1853541671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:28.037556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-91bc1861-fe74-413b-b414-6e1853541671 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:28.039051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-91bc1861-fe74-413b-b414-6e1853541671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:28.104388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 562/1148] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:28.374579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11a4f0-19a9-4f3f-b88a-50597db5f518 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:28.453978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:28.472782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb11a4f0-19a9-4f3f-b88a-50597db5f518 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:28.506396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:28.507054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:28.507335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:28.507609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:28.517369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:28.522019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:28.523140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:28.527945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 587/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:28.529282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc1861-fe74-413b-b414-6e1853541671 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:28.570967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:28.627217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bc1861-fe74-413b-b414-6e1853541671 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:28.659914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:28.660518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:28.660806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:28.661081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:28.661749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:28.662573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:28.664241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:28.672557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 563/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:28.679058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:28.775700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ef12c1-c455-4008-abba-2bd7b193f738 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:28.808877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:28.809497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:28.809775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:28.810045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] PATH_INFO: `/v3/users/164cd24d73924d96b8ad017ed2dd9e2c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:28.811180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=164cd24d73924d96b8ad017ed2dd9e2c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:28.812603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:28.814150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 588/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:28 2022] GET /identity/v3/users/164cd24d73924d96b8ad017ed2dd9e2c => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:28.819952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:28.918652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7d2976-6983-4c5c-9a7d-ebf369a926f3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:28.920099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:28.953166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b15b8c-1195-4f2d-bc5b-313227de3938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:28.953790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15b8c-1195-4f2d-bc5b-313227de3938 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:28.954073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15b8c-1195-4f2d-bc5b-313227de3938 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:28.954347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b15b8c-1195-4f2d-bc5b-313227de3938 None admin] PATH_INFO: `/v3/projects/213df2d7e8384c3a97b125b54277cf93` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:28.955490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b15b8c-1195-4f2d-bc5b-313227de3938 None admin] RBAC: Authorizing `identity:get_project(project_id=213df2d7e8384c3a97b125b54277cf93)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:28.957026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b15b8c-1195-4f2d-bc5b-313227de3938 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:28.958655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 564/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:28 2022] GET /identity/v3/projects/213df2d7e8384c3a97b125b54277cf93 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:28.965316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:28.977112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:29.061948 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c7c97-066c-4223-93f7-2fbffa8be3e3 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:29.094457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0907b3a-9cfc-4260-91b1-1ab17693fad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:29.095130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907b3a-9cfc-4260-91b1-1ab17693fad2 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:29.095413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907b3a-9cfc-4260-91b1-1ab17693fad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:29.095689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0907b3a-9cfc-4260-91b1-1ab17693fad2 None admin] PATH_INFO: `/v3/projects/213df2d7e8384c3a97b125b54277cf93/users/164cd24d73924d96b8ad017ed2dd9e2c/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:29.097563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0907b3a-9cfc-4260-91b1-1ab17693fad2 None admin] RBAC: Authorizing `identity:create_grant(project_id=213df2d7e8384c3a97b125b54277cf93, user_id=164cd24d73924d96b8ad017ed2dd9e2c, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:29.099018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0907b3a-9cfc-4260-91b1-1ab17693fad2 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:29.203947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 589/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:39:28 2022] PUT /identity/v3/projects/213df2d7e8384c3a97b125b54277cf93/users/164cd24d73924d96b8ad017ed2dd9e2c/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:39:31.064963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eeefe-8bb1-41ac-93fe-5a4bc29c6431 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:31.065503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eeefe-8bb1-41ac-93fe-5a4bc29c6431 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:31.065503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553eeefe-8bb1-41ac-93fe-5a4bc29c6431 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:31.066869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 565/1154] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:31.072021 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27420816-2c9b-42f7-abfe-3a460fe32693 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:31.072416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27420816-2c9b-42f7-abfe-3a460fe32693 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:31.072589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27420816-2c9b-42f7-abfe-3a460fe32693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:31.090789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-27420816-2c9b-42f7-abfe-3a460fe32693 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:31.091995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-27420816-2c9b-42f7-abfe-3a460fe32693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:31.152106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:31.157353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 590/1155] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:31.428663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eeefe-8bb1-41ac-93fe-5a4bc29c6431 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:31.526782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553eeefe-8bb1-41ac-93fe-5a4bc29c6431 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:31.560388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:31.561012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:31.561296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:31.561573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:31.571379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:31.576086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:31.577229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:31.578416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 566/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:31.583171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27420816-2c9b-42f7-abfe-3a460fe32693 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:31.683353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27420816-2c9b-42f7-abfe-3a460fe32693 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:31.717679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:31.718304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:31.718586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:31.718897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:31.719569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:31.719875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:31.721255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:31.730674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 591/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:31.736773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:31.773031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:31.843344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c5af3-d742-4849-94ca-1d5d79127d01 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:31.875992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:31.876620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:31.876902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:31.877172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] PATH_INFO: `/v3/users/164cd24d73924d96b8ad017ed2dd9e2c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:31.878280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] RBAC: Authorizing `identity:get_user(user_id=164cd24d73924d96b8ad017ed2dd9e2c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:31.879727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:31.881300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 567/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:31 2022] GET /identity/v3/users/164cd24d73924d96b8ad017ed2dd9e2c => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:31.887311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:31.947642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:31.989455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e876b-150f-4201-a2ec-3f5644812592 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:32.023026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:32.023632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:32.023937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:32.024191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:32.089864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:32.091343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:32.144971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:32.184667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 592/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:32.190871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:32.285275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:32.289251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e656607-5558-4132-9dcd-a566ad6a3900 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:32.322941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e6ea8a-5340-4eee-9a9f-7d34a58fdc29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:32.323566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ea8a-5340-4eee-9a9f-7d34a58fdc29 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:32.323846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ea8a-5340-4eee-9a9f-7d34a58fdc29 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:32.324121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6ea8a-5340-4eee-9a9f-7d34a58fdc29 None admin] PATH_INFO: `/v3/projects/213df2d7e8384c3a97b125b54277cf93` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:32.325233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6ea8a-5340-4eee-9a9f-7d34a58fdc29 None admin] RBAC: Authorizing `identity:get_project(project_id=213df2d7e8384c3a97b125b54277cf93)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:32.326660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e6ea8a-5340-4eee-9a9f-7d34a58fdc29 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:32.328318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 568/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:32 2022] GET /identity/v3/projects/213df2d7e8384c3a97b125b54277cf93 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:32.335113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:32.430023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b3f2df-8e00-4f83-afbc-632c87eae069 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:32.463725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3037454-5189-40c4-a82d-2b4681a21243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:32.464323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3037454-5189-40c4-a82d-2b4681a21243 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:32.464603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3037454-5189-40c4-a82d-2b4681a21243 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:32.464878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3037454-5189-40c4-a82d-2b4681a21243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:32.465599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3037454-5189-40c4-a82d-2b4681a21243 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=213df2d7e8384c3a97b125b54277cf93, user.id=164cd24d73924d96b8ad017ed2dd9e2c) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:32.465911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3037454-5189-40c4-a82d-2b4681a21243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:32.467376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3037454-5189-40c4-a82d-2b4681a21243 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:32.473113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 593/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:32 2022] GET /identity/v3/role_assignments?user.id=164cd24d73924d96b8ad017ed2dd9e2c&scope.project.id=213df2d7e8384c3a97b125b54277cf93&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:34.376464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478749a-7434-461a-a464-bfd7b8ac9067 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:34.377005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478749a-7434-461a-a464-bfd7b8ac9067 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:34.377005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3478749a-7434-461a-a464-bfd7b8ac9067 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:34.378344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 569/1162] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:34.384330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfe628-1925-42dd-8b5f-f99b4bddab25 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:34.384737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfe628-1925-42dd-8b5f-f99b4bddab25 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:34.384867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dfe628-1925-42dd-8b5f-f99b4bddab25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:34.402498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-66dfe628-1925-42dd-8b5f-f99b4bddab25 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:34.403739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-66dfe628-1925-42dd-8b5f-f99b4bddab25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:34.421736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:34.472765 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 594/1163] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:34.741600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478749a-7434-461a-a464-bfd7b8ac9067 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:34.846124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3478749a-7434-461a-a464-bfd7b8ac9067 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:34.882373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:34.883004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:34.883290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:34.883561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:34.917030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:34.953342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:34.954802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:35.055203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 570/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:35.061307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfe628-1925-42dd-8b5f-f99b4bddab25 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:35.164315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dfe628-1925-42dd-8b5f-f99b4bddab25 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:35.201028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094fe835-828c-41b8-a993-5a17cbc2fc1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:35.201676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe835-828c-41b8-a993-5a17cbc2fc1e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:35.202107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe835-828c-41b8-a993-5a17cbc2fc1e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:35.202393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094fe835-828c-41b8-a993-5a17cbc2fc1e None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:35.209650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fe835-828c-41b8-a993-5a17cbc2fc1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:35.211156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094fe835-828c-41b8-a993-5a17cbc2fc1e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-094fe835-828c-41b8-a993-5a17cbc2fc1e None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:35.224424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:35.226562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:35.228589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 595/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:39:35 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:35.233609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:35.303902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:35.339691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98174f-598d-42ec-97e8-df7a353d183e None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:35.377730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb1378d-a77c-418a-8ba3-30e8e060f01a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:35.378401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1378d-a77c-418a-8ba3-30e8e060f01a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:35.378605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1378d-a77c-418a-8ba3-30e8e060f01a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:35.378917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb1378d-a77c-418a-8ba3-30e8e060f01a None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:35.379568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1378d-a77c-418a-8ba3-30e8e060f01a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:35.379870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1378d-a77c-418a-8ba3-30e8e060f01a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:35.381762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb1378d-a77c-418a-8ba3-30e8e060f01a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:35.389769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 571/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Wed Aug 24 06:39:35 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:37.355945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c4824-5ffe-402c-bed1-1916b3431b43 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:37.356567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c4824-5ffe-402c-bed1-1916b3431b43 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:37.356567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c4824-5ffe-402c-bed1-1916b3431b43 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:37.357837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 596/1167] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:37.363519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4e2d-0e59-407f-a3c4-8c1244e91bfc None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:37.363974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4e2d-0e59-407f-a3c4-8c1244e91bfc None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:37.364083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ef4e2d-0e59-407f-a3c4-8c1244e91bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:37.382345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-15ef4e2d-0e59-407f-a3c4-8c1244e91bfc None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:37.383598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-15ef4e2d-0e59-407f-a3c4-8c1244e91bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:37.452146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 572/1168] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:37.721684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c4824-5ffe-402c-bed1-1916b3431b43 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:37.738381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:37.833319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c4824-5ffe-402c-bed1-1916b3431b43 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:37.870329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f450e62-b926-402f-9886-4fd5906b1bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:37.870975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f450e62-b926-402f-9886-4fd5906b1bed None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:37.871260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f450e62-b926-402f-9886-4fd5906b1bed None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:37.871536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f450e62-b926-402f-9886-4fd5906b1bed None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:37.872221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f450e62-b926-402f-9886-4fd5906b1bed None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:37.873597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f450e62-b926-402f-9886-4fd5906b1bed None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:37.964992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 597/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Wed Aug 24 06:39:37 2022] POST /identity/v3/domains => generated 267 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:39:39.951336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96c94-a2e4-450c-a7ba-951951f7c41c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:39.951888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96c94-a2e4-450c-a7ba-951951f7c41c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:39.951888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d96c94-a2e4-450c-a7ba-951951f7c41c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:39.953232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 573/1170] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:39.959152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f98d-25cf-4b04-859d-42671022fe1a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:39.959543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f98d-25cf-4b04-859d-42671022fe1a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:39.959695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff4f98d-25cf-4b04-859d-42671022fe1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:39.977245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-fff4f98d-25cf-4b04-859d-42671022fe1a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:39.978361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fff4f98d-25cf-4b04-859d-42671022fe1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:40.042713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 598/1171] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:40.309702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96c94-a2e4-450c-a7ba-951951f7c41c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:40.371374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:40.414568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d96c94-a2e4-450c-a7ba-951951f7c41c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:40.450551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6792b46a-4c9e-46b3-87dd-45e29db96121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:40.451217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b46a-4c9e-46b3-87dd-45e29db96121 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:40.451497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b46a-4c9e-46b3-87dd-45e29db96121 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:40.451768 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6792b46a-4c9e-46b3-87dd-45e29db96121 None admin] PATH_INFO: `/v3/domains/0713bdb8531a4de3b1bd2f940c821096` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:40.463218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b46a-4c9e-46b3-87dd-45e29db96121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=0713bdb8531a4de3b1bd2f940c821096)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:40.464728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6792b46a-4c9e-46b3-87dd-45e29db96121 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:40.466403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 574/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Wed Aug 24 06:39:40 2022] GET /identity/v3/domains/0713bdb8531a4de3b1bd2f940c821096 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:40.472361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4f98d-25cf-4b04-859d-42671022fe1a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:40.478338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:40.581207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff4f98d-25cf-4b04-859d-42671022fe1a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:40.646421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434b39af-07c8-44be-b3a9-7b5e38166b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:40.647054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b39af-07c8-44be-b3a9-7b5e38166b66 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:40.647336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b39af-07c8-44be-b3a9-7b5e38166b66 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:40.647613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434b39af-07c8-44be-b3a9-7b5e38166b66 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:40.648269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b39af-07c8-44be-b3a9-7b5e38166b66 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:40.649730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434b39af-07c8-44be-b3a9-7b5e38166b66 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:40.770705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 599/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:39:40 2022] POST /identity/v3/projects => generated 361 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:39:42.776959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd946e9-2eac-43b3-8dd7-8b3d9bf0c6cc None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:42.777533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd946e9-2eac-43b3-8dd7-8b3d9bf0c6cc None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:42.777533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd946e9-2eac-43b3-8dd7-8b3d9bf0c6cc None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:42.778907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 575/1174] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:42.784687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de08b06-c646-44a9-a670-e36afe5c81c9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:42.785141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de08b06-c646-44a9-a670-e36afe5c81c9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:42.785244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de08b06-c646-44a9-a670-e36afe5c81c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:42.804913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-7de08b06-c646-44a9-a670-e36afe5c81c9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:42.806115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7de08b06-c646-44a9-a670-e36afe5c81c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:42.856698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:42.874102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 600/1175] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:43.154022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd946e9-2eac-43b3-8dd7-8b3d9bf0c6cc None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:43.258268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd946e9-2eac-43b3-8dd7-8b3d9bf0c6cc None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:43.278459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:43.292670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab17c027-6dd4-44ba-b74e-ffe8ac8316cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:43.293389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17c027-6dd4-44ba-b74e-ffe8ac8316cb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:43.293667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17c027-6dd4-44ba-b74e-ffe8ac8316cb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:43.293943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab17c027-6dd4-44ba-b74e-ffe8ac8316cb None admin] PATH_INFO: `/v3/domains/0713bdb8531a4de3b1bd2f940c821096` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:43.295100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17c027-6dd4-44ba-b74e-ffe8ac8316cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=0713bdb8531a4de3b1bd2f940c821096)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:43.296536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab17c027-6dd4-44ba-b74e-ffe8ac8316cb None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:43.298103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 576/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Wed Aug 24 06:39:43 2022] GET /identity/v3/domains/0713bdb8531a4de3b1bd2f940c821096 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:43.304095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de08b06-c646-44a9-a670-e36afe5c81c9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:43.399771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de08b06-c646-44a9-a670-e36afe5c81c9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:43.433313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938c12be-2aa9-4e8b-8ef3-d346818a4ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:43.433849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c12be-2aa9-4e8b-8ef3-d346818a4ab7 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:43.434134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c12be-2aa9-4e8b-8ef3-d346818a4ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:43.434409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c12be-2aa9-4e8b-8ef3-d346818a4ab7 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:43.435100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c12be-2aa9-4e8b-8ef3-d346818a4ab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:43.436552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938c12be-2aa9-4e8b-8ef3-d346818a4ab7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:43.505716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 601/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:39:43 2022] POST /identity/v3/users => generated 311 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:39:45.463273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8ec27-255d-4aa5-affb-b859ef997e1d None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:45.463828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8ec27-255d-4aa5-affb-b859ef997e1d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:45.463828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8ec27-255d-4aa5-affb-b859ef997e1d None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:45.465183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 577/1178] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:45.470651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7b40f-cfa7-49c2-bcdc-34a629d0a081 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:45.471146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7b40f-cfa7-49c2-bcdc-34a629d0a081 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:45.471248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7b40f-cfa7-49c2-bcdc-34a629d0a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:45.489890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3ba7b40f-cfa7-49c2-bcdc-34a629d0a081 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:45.491166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3ba7b40f-cfa7-49c2-bcdc-34a629d0a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:45.525944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:45.561515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 602/1179] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:45.825697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8ec27-255d-4aa5-affb-b859ef997e1d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:45.926539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8ec27-255d-4aa5-affb-b859ef997e1d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:45.960395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:45.961030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:45.961316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:45.961589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:45.971944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:45.977072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:45.978360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:45.979515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 578/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:45.984450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7b40f-cfa7-49c2-bcdc-34a629d0a081 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:46.084025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7b40f-cfa7-49c2-bcdc-34a629d0a081 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:46.118330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:46.118968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:46.119253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:46.119528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:46.120193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:46.120497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:46.121867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:46.130172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 603/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:46.136120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:46.189188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:46.240952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db49b4-44ba-4721-b0ec-234757e46eca None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:46.275547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:46.276514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:46.276514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:46.276753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] PATH_INFO: `/v3/users/08e88f374d674e8ab4820ed0f5f2d313` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:46.290932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] RBAC: Authorizing `identity:get_user(user_id=08e88f374d674e8ab4820ed0f5f2d313)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:46.292376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:46.294025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 579/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:46 2022] GET /identity/v3/users/08e88f374d674e8ab4820ed0f5f2d313 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:46.300417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:46.334423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:46.399314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d11c90f-112b-437a-9ae9-a811bdee09ce None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:46.431891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:46.432482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:46.432759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:46.433041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:46.502238 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:46.503636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:46.537113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:46.602716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 604/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:46.608632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:46.711350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637d454c-b515-4971-b1a6-5bc009630bad None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:46.719589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:46.748772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb868a1-8a87-48b3-bfb3-52740a41eaa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:46.749476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb868a1-8a87-48b3-bfb3-52740a41eaa2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:46.749791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb868a1-8a87-48b3-bfb3-52740a41eaa2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:46.750075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb868a1-8a87-48b3-bfb3-52740a41eaa2 None admin] PATH_INFO: `/v3/projects/e359b870099b4e3ab071c1e3363bc526` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:46.751248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb868a1-8a87-48b3-bfb3-52740a41eaa2 None admin] RBAC: Authorizing `identity:get_project(project_id=e359b870099b4e3ab071c1e3363bc526)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:46.752734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb868a1-8a87-48b3-bfb3-52740a41eaa2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:46.754966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 580/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:46 2022] GET /identity/v3/projects/e359b870099b4e3ab071c1e3363bc526 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:46.761232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:46.859734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5798f-57a2-42e0-b52c-43ac99a4afb7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:46.892831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9376215-66a7-4959-b06b-beba23b43a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:46.893423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9376215-66a7-4959-b06b-beba23b43a8b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:46.893705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9376215-66a7-4959-b06b-beba23b43a8b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:46.893980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9376215-66a7-4959-b06b-beba23b43a8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:46.894727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9376215-66a7-4959-b06b-beba23b43a8b None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=e359b870099b4e3ab071c1e3363bc526, user.id=08e88f374d674e8ab4820ed0f5f2d313) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:46.895059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9376215-66a7-4959-b06b-beba23b43a8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:46.896484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9376215-66a7-4959-b06b-beba23b43a8b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:46.898202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:46.902153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 605/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:46 2022] GET /identity/v3/role_assignments?user.id=08e88f374d674e8ab4820ed0f5f2d313&scope.project.id=e359b870099b4e3ab071c1e3363bc526&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:48.802109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16ba5-223b-4b13-abd4-d06a924c06c4 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:48.802655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16ba5-223b-4b13-abd4-d06a924c06c4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:48.802655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc16ba5-223b-4b13-abd4-d06a924c06c4 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:48.804049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 581/1186] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:48.809648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e31e7-a536-4102-8e4c-381cd6441062 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:48.810077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e31e7-a536-4102-8e4c-381cd6441062 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:48.810215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e31e7-a536-4102-8e4c-381cd6441062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:48.828711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d96e31e7-a536-4102-8e4c-381cd6441062 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:48.829971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d96e31e7-a536-4102-8e4c-381cd6441062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:48.901828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 606/1187] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:49.176250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc16ba5-223b-4b13-abd4-d06a924c06c4 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:49.284389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc16ba5-223b-4b13-abd4-d06a924c06c4 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:49.344237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:49.345322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:49.345826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:49.346318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:49.365735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:49.375239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:49.376449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:39:49.377551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 582/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:49.385633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e31e7-a536-4102-8e4c-381cd6441062 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:49.498237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e31e7-a536-4102-8e4c-381cd6441062 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:49.526481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:49.534406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:49.552550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:49.552550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:49.552550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:49.552550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:49.552550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:49.552550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:49.553083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 607/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:49.553176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:49.588754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:49.655491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b50469-3927-4214-b84a-78d0ff7a70bb None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:49.690878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:49.692046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:49.692414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:49.692699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] PATH_INFO: `/v3/users/08e88f374d674e8ab4820ed0f5f2d313` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:49.693925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] RBAC: Authorizing `identity:get_user(user_id=08e88f374d674e8ab4820ed0f5f2d313)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:49.695421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:49.697081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 583/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:49 2022] GET /identity/v3/users/08e88f374d674e8ab4820ed0f5f2d313 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:49.703501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:49.806319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be774de-4d7e-43a1-877b-43bbf7cffc6b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:49.843131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8deaa4-09b1-4993-9b95-660eca0aa6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:49.843802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8deaa4-09b1-4993-9b95-660eca0aa6da None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:49.844041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8deaa4-09b1-4993-9b95-660eca0aa6da None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:49.844315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8deaa4-09b1-4993-9b95-660eca0aa6da None admin] PATH_INFO: `/v3/projects/e359b870099b4e3ab071c1e3363bc526` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:49.845451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8deaa4-09b1-4993-9b95-660eca0aa6da None admin] RBAC: Authorizing `identity:get_project(project_id=e359b870099b4e3ab071c1e3363bc526)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:49.846951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8deaa4-09b1-4993-9b95-660eca0aa6da None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:49.848677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 608/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:49 2022] GET /identity/v3/projects/e359b870099b4e3ab071c1e3363bc526 => generated 361 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:49.854731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:49.963126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baef287-0b12-4596-83d2-fbdda24e609d None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:49.964744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:50.000257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148b1e7-08e6-4ceb-8963-f5169a5d2e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:50.000991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148b1e7-08e6-4ceb-8963-f5169a5d2e66 None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:50.001366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148b1e7-08e6-4ceb-8963-f5169a5d2e66 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:50.001622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148b1e7-08e6-4ceb-8963-f5169a5d2e66 None admin] PATH_INFO: `/v3/projects/e359b870099b4e3ab071c1e3363bc526/users/08e88f374d674e8ab4820ed0f5f2d313/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:50.004430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148b1e7-08e6-4ceb-8963-f5169a5d2e66 None admin] RBAC: Authorizing `identity:create_grant(project_id=e359b870099b4e3ab071c1e3363bc526, user_id=08e88f374d674e8ab4820ed0f5f2d313, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:50.005895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148b1e7-08e6-4ceb-8963-f5169a5d2e66 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:50.094304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 584/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:39:49 2022] PUT /identity/v3/projects/e359b870099b4e3ab071c1e3363bc526/users/08e88f374d674e8ab4820ed0f5f2d313/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:39:51.953787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a95b97-31dc-4dc6-8e9a-ff226ef17e8b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:51.954353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a95b97-31dc-4dc6-8e9a-ff226ef17e8b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:51.954353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a95b97-31dc-4dc6-8e9a-ff226ef17e8b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:51.955685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 609/1193] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:39:51.960930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176acef-4385-4b8a-9516-7271f7ffd147 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:51.961349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176acef-4385-4b8a-9516-7271f7ffd147 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:51.961494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3176acef-4385-4b8a-9516-7271f7ffd147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:51.979980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3176acef-4385-4b8a-9516-7271f7ffd147 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:39:51.981109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3176acef-4385-4b8a-9516-7271f7ffd147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:39:52.047316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 585/1194] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:39:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:39:52.312420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a95b97-31dc-4dc6-8e9a-ff226ef17e8b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:52.371788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:52.414776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a95b97-31dc-4dc6-8e9a-ff226ef17e8b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:52.447289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:52.447914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:52.448201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:52.448476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:52.459351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:39:52.464048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:39:52.465143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:39:52.466223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 610/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:39:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:39:52.471343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176acef-4385-4b8a-9516-7271f7ffd147 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:52.561435 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:52.574991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3176acef-4385-4b8a-9516-7271f7ffd147 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:52.604740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:52.605348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:52.605634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:52.605913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:52.606643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:52.607212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:52.609109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:52.617581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 586/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:39:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:52.623511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:52.727329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad9e89f-053c-41d4-af7f-6f01ecbe6f1a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:52.744508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:52.761139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:52.761794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:52.762078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:52.762354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] PATH_INFO: `/v3/users/08e88f374d674e8ab4820ed0f5f2d313` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:52.763517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] RBAC: Authorizing `identity:get_user(user_id=08e88f374d674e8ab4820ed0f5f2d313)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:52.764958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:52.766548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 611/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Wed Aug 24 06:39:52 2022] GET /identity/v3/users/08e88f374d674e8ab4820ed0f5f2d313 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:52.772891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:52.881058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fcd5c8-c092-4110-b8d3-7c63406fb3f7 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:52.918043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:52.918661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:52.918971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:52.919245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:52.944225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:52.989369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:52.990947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:53.086313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 587/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:39:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:39:53.092518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:53.188092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e6f6e-bf92-42d1-844c-a90455e5d375 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:53.220768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a937045a-33ef-4864-b588-445b86080981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:53.221383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937045a-33ef-4864-b588-445b86080981 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:53.221660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937045a-33ef-4864-b588-445b86080981 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:53.221937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a937045a-33ef-4864-b588-445b86080981 None admin] PATH_INFO: `/v3/projects/e359b870099b4e3ab071c1e3363bc526` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:53.223084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937045a-33ef-4864-b588-445b86080981 None admin] RBAC: Authorizing `identity:get_project(project_id=e359b870099b4e3ab071c1e3363bc526)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:53.224520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a937045a-33ef-4864-b588-445b86080981 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:53.226112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 612/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Wed Aug 24 06:39:53 2022] GET /identity/v3/projects/e359b870099b4e3ab071c1e3363bc526 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:39:53.232388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:39:53.285622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:39:53.330016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4f4302-4345-4649-9657-c9e228185e2a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:39:53.362665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56de012e-b8f6-4406-9e94-a0498c9527c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:39:53.363292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de012e-b8f6-4406-9e94-a0498c9527c3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:39:53.363578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de012e-b8f6-4406-9e94-a0498c9527c3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:39:53.363850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56de012e-b8f6-4406-9e94-a0498c9527c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:39:53.364574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de012e-b8f6-4406-9e94-a0498c9527c3 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=e359b870099b4e3ab071c1e3363bc526, user.id=08e88f374d674e8ab4820ed0f5f2d313) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:39:53.364885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de012e-b8f6-4406-9e94-a0498c9527c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:39:53.366302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56de012e-b8f6-4406-9e94-a0498c9527c3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:39:53.371860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 588/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:39:53 2022] GET /identity/v3/role_assignments?user.id=08e88f374d674e8ab4820ed0f5f2d313&scope.project.id=e359b870099b4e3ab071c1e3363bc526&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:40:03.216650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=73 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:40:03.369351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=41 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:08.200303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768616-8909-4fe5-9993-64868944d407 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:08.200897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768616-8909-4fe5-9993-64868944d407 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:08.200897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82768616-8909-4fe5-9993-64868944d407 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:08.202138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 613/1201] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:08.207395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bba57b-ec3b-4538-aab6-7d72ac01aede None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:08.207826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bba57b-ec3b-4538-aab6-7d72ac01aede None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:08.207954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bba57b-ec3b-4538-aab6-7d72ac01aede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:08.226217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a4bba57b-ec3b-4538-aab6-7d72ac01aede None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:08.240560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a4bba57b-ec3b-4538-aab6-7d72ac01aede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:08.292744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 589/1202] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:08.558234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768616-8909-4fe5-9993-64868944d407 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:08.663344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82768616-8909-4fe5-9993-64868944d407 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:08.699167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:08.699802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:08.700085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:08.700364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:08.710449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:08.711968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:08.726647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:08.727933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:08.729181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:08.729181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:08.729181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:08.729181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 614/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:08.734375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bba57b-ec3b-4538-aab6-7d72ac01aede None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:08.831662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bba57b-ec3b-4538-aab6-7d72ac01aede None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:08.859532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:08.865807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56099575-e2dd-49af-aac4-461bfebb567a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:08.867784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099575-e2dd-49af-aac4-461bfebb567a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:08.867784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099575-e2dd-49af-aac4-461bfebb567a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:08.867784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56099575-e2dd-49af-aac4-461bfebb567a None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:08.867784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099575-e2dd-49af-aac4-461bfebb567a None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:08.868313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099575-e2dd-49af-aac4-461bfebb567a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:08.869404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56099575-e2dd-49af-aac4-461bfebb567a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:08.880993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 590/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:08.887218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:08.942985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:08.990738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cf3688-e79c-4a2d-bf56-8f6df6edb896 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:09.023433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9961b3bf-f28f-409e-bf40-c9bf883e42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:09.024041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b3bf-f28f-409e-bf40-c9bf883e42b4 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:09.024322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b3bf-f28f-409e-bf40-c9bf883e42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:09.024598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9961b3bf-f28f-409e-bf40-c9bf883e42b4 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:09.025245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961b3bf-f28f-409e-bf40-c9bf883e42b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:09.026673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9961b3bf-f28f-409e-bf40-c9bf883e42b4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:09.139221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 615/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Wed Aug 24 06:41:08 2022] POST /identity/v3/users => generated 251 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:41:11.082097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9263ab-eaa4-4190-ac1f-1d39f752568f None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:11.082654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9263ab-eaa4-4190-ac1f-1d39f752568f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:11.082654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9263ab-eaa4-4190-ac1f-1d39f752568f None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:11.084041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 591/1206] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:11.090076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329f7b-1d5e-4cdf-92db-89325608ca2d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:11.090499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329f7b-1d5e-4cdf-92db-89325608ca2d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:11.090637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e329f7b-1d5e-4cdf-92db-89325608ca2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:11.108794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6e329f7b-1d5e-4cdf-92db-89325608ca2d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:11.109995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6e329f7b-1d5e-4cdf-92db-89325608ca2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:11.176065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 616/1207] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:11.444603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9263ab-eaa4-4190-ac1f-1d39f752568f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:11.547866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9263ab-eaa4-4190-ac1f-1d39f752568f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:11.582262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:11.582951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:11.583233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:11.583513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:11.593950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:41:11.598702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:11.599833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:11.601161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 592/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:41:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:11.605944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e329f7b-1d5e-4cdf-92db-89325608ca2d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:11.644900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:11.703976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e329f7b-1d5e-4cdf-92db-89325608ca2d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:11.736713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:11.737316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:11.737596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:11.737864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:11.738516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:11.738842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:11.740195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:11.747776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 617/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:41:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:11.753469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:11.805165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:11.854274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53326-597b-463e-bc13-bc953bd0176a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:11.887150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:11.887786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:11.888069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:11.888344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:11.898099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:11.899573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:11.914590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:11.915749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:11.917037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:11.917037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:11.917037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:11.917037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 593/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:11.921800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:12.019404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:12.022154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c163f1b1-ce46-4dd3-84a2-416f3305c808 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:12.055846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:12.056445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:12.056717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:12.056984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:12.057616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:12.058472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:12.059862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:12.070955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 618/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:12.077549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:12.173731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9609d04a-4a47-430a-880b-02af3e4e081f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:12.175279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:12.208204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:12.208862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:12.209145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:12.209422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:12.216593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:12.218097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:41:12.229614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:12.233684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:12.234972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 594/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:12.237119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:12.335121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8183e340-4b37-4dfd-a4c1-4d22dee87883 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:12.367668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:12.368270 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:12.368555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:12.368830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:12.369547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:12.369882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:12.372160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:12.391644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 619/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 06:41:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:12.397530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:12.497160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e49fd8-8f8f-4974-b8e7-eba8d9c61a03 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:12.531010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:12.531606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:12.531888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:12.532165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:12.563396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:12.600836 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:12.602212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:12.706350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 595/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:41:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:12.712319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:12.733883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:12.814046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6144519-6153-470d-80d7-cd1aa06679fe None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:12.849480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:12.850167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:12.850388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:12.850671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:12.861352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:12.862878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:12.877548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:12.878695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:12.885673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:12.885673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:12.885673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:12.885673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 620/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:12.886009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:12.945739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:12.982912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc0b055-a4da-4b4d-a1d0-f06e84e9219e None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:13.015620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:13.016226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:13.016511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:13.016789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:13.017439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:13.017761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:13.019170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:13.032378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 596/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:13.037494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:13.105554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:13.135675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4b99ba-9c4d-4761-a5f9-c58064daa63a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:13.168990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:13.169611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:13.169895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:13.170175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:13.176790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:13.178290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:41:13.189462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:13.190364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:13.191397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 621/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:41:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:13.196464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:13.295041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb12d382-0bee-49b1-adb7-8a3362365282 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:13.317065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:13.328972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149520e5-512d-449b-bb37-0fd7e9fb00de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:13.329525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149520e5-512d-449b-bb37-0fd7e9fb00de None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:13.329808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149520e5-512d-449b-bb37-0fd7e9fb00de None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:13.330085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149520e5-512d-449b-bb37-0fd7e9fb00de None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:13.330790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149520e5-512d-449b-bb37-0fd7e9fb00de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:13.331119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149520e5-512d-449b-bb37-0fd7e9fb00de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:13.332595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149520e5-512d-449b-bb37-0fd7e9fb00de None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:13.346131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 597/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:41:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:13.352277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:13.455473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2edffc-5926-457c-a78d-a40b55e51c1a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:13.482512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:13.488186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136655be-11f6-40f3-9260-9160bf7c955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:13.488781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136655be-11f6-40f3-9260-9160bf7c955f None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:13.489058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136655be-11f6-40f3-9260-9160bf7c955f None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:13.489333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136655be-11f6-40f3-9260-9160bf7c955f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:13.490051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136655be-11f6-40f3-9260-9160bf7c955f None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=1c15217a015c4214b6769393fe48c1dd) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:13.490357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136655be-11f6-40f3-9260-9160bf7c955f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:13.491806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136655be-11f6-40f3-9260-9160bf7c955f None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:13.497542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 622/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:41:13 2022] GET /identity/v3/role_assignments?user.id=1c15217a015c4214b6769393fe48c1dd&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:15.359799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b673-ce65-4974-9227-d1f057bb3ca5 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:15.360453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b673-ce65-4974-9227-d1f057bb3ca5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:15.360453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b84b673-ce65-4974-9227-d1f057bb3ca5 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:15.361696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 598/1220] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:15.366996 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e087-b518-45ca-9eb9-b361e31eefac None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:15.367439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e087-b518-45ca-9eb9-b361e31eefac None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:15.367540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4483e087-b518-45ca-9eb9-b361e31eefac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:15.387080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4483e087-b518-45ca-9eb9-b361e31eefac None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:15.388286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4483e087-b518-45ca-9eb9-b361e31eefac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:15.452961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 623/1221] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:15.718996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b673-ce65-4974-9227-d1f057bb3ca5 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:15.827488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b84b673-ce65-4974-9227-d1f057bb3ca5 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:15.861422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:15.862067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:15.862348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:15.862623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] PATH_INFO: `/v3/roles/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:15.872636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:41:15.877366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:15.878504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:15.879512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 599/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:41:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:15.884629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e087-b518-45ca-9eb9-b361e31eefac None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:15.983466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4483e087-b518-45ca-9eb9-b361e31eefac None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:16.006291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:16.016614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:16.017220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:16.017505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:16.017783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:16.018450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] RBAC: Adding query filter params (name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:16.018755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:16.020159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:16.028565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 624/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:41:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:16.034670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:16.078472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:16.133801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f89f5a-087f-4f88-94b4-251a18edbfac None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:16.168348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:16.168968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:16.169244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:16.169512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:16.179108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:16.180529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:16.194695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:16.199618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:16.200728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:16.200728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:16.200728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:16.200728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 600/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:16.202206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:16.299876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe83ff-1cf9-4962-b1de-e860c0af1268 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:16.332895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:16.333499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:16.333783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:16.334061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:16.334704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:16.335039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:16.336410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:16.349009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 625/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:16.355953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:16.457522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:16.464780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baffab9e-195f-4560-82ff-31b1474b0edb None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:16.499253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:16.499884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:16.500166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:16.500442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:16.507456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:16.508897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:41:16.520412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:16.521860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:16.523150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 601/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:16.528166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:16.574838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:16.627581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e18f5f-3378-4e2c-8689-fa0a9db4258e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:16.661722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:16.662339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:16.662621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:16.662951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:16.663699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:16.664077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:16.676010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:16.689378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 626/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 06:41:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:16.695336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:16.798524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907115ab-5782-4c33-9ac4-cc33e24ee3c9 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:16.832742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:16.833349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:16.833630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:16.833903 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:16.844170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:16.845631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:16.859543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:16.860675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:16.861872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:16.861872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:16.861872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:16.861872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 602/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:16.866704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:16.965286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77ade7-aa44-4d98-b8e1-dda08196dc51 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:16.967580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:16.999139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:16.999745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:17.000030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:17.000331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:17.000982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:17.001286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:17.002655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:17.013869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 627/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:17.020031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:17.029323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:17.119098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825e1e83-8f98-430f-b504-297bc4d0142c None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:17.152450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:17.153076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:17.153359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:17.153636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:17.160750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:17.162216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:41:17.174115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:17.176058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:17.177366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 603/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:41:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:17.181369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:17.282084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c8bba8-ef14-4dec-b851-a74f82759f6d None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:17.315007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa754e-059c-4f81-a2dc-513631872136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:17.315607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa754e-059c-4f81-a2dc-513631872136 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:17.315887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa754e-059c-4f81-a2dc-513631872136 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:17.316164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa754e-059c-4f81-a2dc-513631872136 None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:17.316844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa754e-059c-4f81-a2dc-513631872136 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:17.317147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa754e-059c-4f81-a2dc-513631872136 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:17.318574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa754e-059c-4f81-a2dc-513631872136 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:17.330718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 628/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:41:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:17.337015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:17.402689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:17.436772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4537a3-f892-4e4c-af78-442c01ccfff0 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:17.470619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cc3b2e-ee48-4ac9-9eb4-ec2fe9a624ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:17.471312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3b2e-ee48-4ac9-9eb4-ec2fe9a624ec None admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:17.471597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3b2e-ee48-4ac9-9eb4-ec2fe9a624ec None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:17.471873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cc3b2e-ee48-4ac9-9eb4-ec2fe9a624ec None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/1c15217a015c4214b6769393fe48c1dd/roles/88decb556961404a9be5356f86b742f1` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:17.486188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc3b2e-ee48-4ac9-9eb4-ec2fe9a624ec None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=1c15217a015c4214b6769393fe48c1dd, role_id=88decb556961404a9be5356f86b742f1)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:17.487653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cc3b2e-ee48-4ac9-9eb4-ec2fe9a624ec None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:17.630047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 604/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:41:17 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/1c15217a015c4214b6769393fe48c1dd/roles/88decb556961404a9be5356f86b742f1 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:41:19.515069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71985b4-b6d4-4f72-9c70-830b12181667 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:19.515628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71985b4-b6d4-4f72-9c70-830b12181667 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:19.515628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71985b4-b6d4-4f72-9c70-830b12181667 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:19.516956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 629/1233] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:19.522261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9359b71-5b1e-477a-90a8-a0a250dcddfa None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:19.522702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9359b71-5b1e-477a-90a8-a0a250dcddfa None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:19.522829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9359b71-5b1e-477a-90a8-a0a250dcddfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:19.541471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b9359b71-5b1e-477a-90a8-a0a250dcddfa None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:19.543289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b9359b71-5b1e-477a-90a8-a0a250dcddfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:19.608644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 605/1234] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:19.878415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71985b4-b6d4-4f72-9c70-830b12181667 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:19.903447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:19.980786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71985b4-b6d4-4f72-9c70-830b12181667 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:20.015032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:20.015662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:20.015943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:20.016217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] PATH_INFO: `/v3/roles/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:20.026995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:41:20.031924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:20.033375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:20.034633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 630/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Wed Aug 24 06:41:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:20.040331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9359b71-5b1e-477a-90a8-a0a250dcddfa None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:20.085487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:20.139104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9359b71-5b1e-477a-90a8-a0a250dcddfa None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:20.173846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:20.174453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:20.174741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:20.175040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:20.175742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] RBAC: Adding query filter params (name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:20.176047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:20.177595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:20.185713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 606/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Wed Aug 24 06:41:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:20.191516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:20.276858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:20.292109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa586e7-5fcb-4b4d-99b8-89c30a48b68a None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:20.324849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22283022-39e8-4b86-8c79-886d7822face None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:20.325465 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22283022-39e8-4b86-8c79-886d7822face None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:20.325741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22283022-39e8-4b86-8c79-886d7822face None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:20.326008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22283022-39e8-4b86-8c79-886d7822face None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:20.335467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22283022-39e8-4b86-8c79-886d7822face None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:20.336895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22283022-39e8-4b86-8c79-886d7822face None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-22283022-39e8-4b86-8c79-886d7822face None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:20.350899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:20.352067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:20.353440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:20.353440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:20.353440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:20.353440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 631/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:20.357895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:20.458277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efddbdcb-4afd-43df-8e62-5e4a035d716f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:20.467035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:20.491808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:20.492412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:20.492699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:20.492974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:20.493614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:20.493919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:20.495837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:20.507481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 607/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:20.513844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22283022-39e8-4b86-8c79-886d7822face None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:20.615533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22283022-39e8-4b86-8c79-886d7822face None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:20.653492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:20.654170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:20.654456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:20.654734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] PATH_INFO: `/v3/users/placement` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:20.658467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:20.663783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:20.669096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:41:20.682799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:20.684075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:20.685305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:20.688882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 632/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:20.689928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:20.798990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f036a871-4ce1-4e19-92ad-4fd0f67375a8 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:20.834498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:20.835149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:20.835433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:20.835707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:20.836527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:20.836777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:20.838210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:20.857434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 608/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 06:41:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:41:20.863513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:20.969418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bbc158-1e96-49b2-851a-662ce24ca03b None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:21.003217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498245-30da-4456-9130-d694069ae758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:21.003819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498245-30da-4456-9130-d694069ae758 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:21.004104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498245-30da-4456-9130-d694069ae758 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:21.004379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9498245-30da-4456-9130-d694069ae758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:21.064539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:21.071416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9498245-30da-4456-9130-d694069ae758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:21.072903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9498245-30da-4456-9130-d694069ae758 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:21.169914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 633/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:41:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:21.175833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:21.203339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:21.273548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce5f31d-5158-428e-9f82-9b22a69762e1 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:21.306952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:21.307601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:21.307883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:21.308171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:21.317935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:21.319411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:21.333911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:21.335075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:21.336163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:21.336163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:21.336163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:21.336163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 609/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:21.341498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498245-30da-4456-9130-d694069ae758 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:21.437272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:21.443182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9498245-30da-4456-9130-d694069ae758 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:21.479308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:21.479907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:21.480185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:21.480456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:21.481089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:21.481421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:21.482795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:21.493696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 634/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:21.500959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:21.578402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:21.599172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0955747b-bf33-4785-acdb-7f7d5cf1cad2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:21.632193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:21.632813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:21.633094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:21.633371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:21.639784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:21.641285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:41:21.652776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:21.653885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:21.655200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 610/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:41:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:21.660200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:21.760873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7447372b-665b-49a8-997d-7e1cce1f1867 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:21.795449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25062c-f5a6-466d-8c47-3af7bb02ce4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:21.796088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25062c-f5a6-466d-8c47-3af7bb02ce4b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:21.796746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25062c-f5a6-466d-8c47-3af7bb02ce4b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:21.796746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25062c-f5a6-466d-8c47-3af7bb02ce4b None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:21.797274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25062c-f5a6-466d-8c47-3af7bb02ce4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:21.797578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25062c-f5a6-466d-8c47-3af7bb02ce4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:21.799038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25062c-f5a6-466d-8c47-3af7bb02ce4b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:21.810716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 635/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:41:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:21.817191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:21.916446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a98fe0-aa2f-4001-9db8-89e4595b7d41 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:21.949056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66454906-6048-4495-97f1-ff4f3ca70cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:21.949659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454906-6048-4495-97f1-ff4f3ca70cdd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:21.949943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454906-6048-4495-97f1-ff4f3ca70cdd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:21.950216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66454906-6048-4495-97f1-ff4f3ca70cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:21.950966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66454906-6048-4495-97f1-ff4f3ca70cdd None admin] RBAC: Adding query filter params (role.id=88decb556961404a9be5356f86b742f1, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=1c15217a015c4214b6769393fe48c1dd) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:21.951276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66454906-6048-4495-97f1-ff4f3ca70cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:21.952688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66454906-6048-4495-97f1-ff4f3ca70cdd None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:21.958371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 611/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:41:21 2022] GET /identity/v3/role_assignments?user.id=1c15217a015c4214b6769393fe48c1dd&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=88decb556961404a9be5356f86b742f1 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:23.871364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebbe0-848e-48fe-b5c0-f30f0f60a8ff None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:23.871931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebbe0-848e-48fe-b5c0-f30f0f60a8ff None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:23.871931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aebbe0-848e-48fe-b5c0-f30f0f60a8ff None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:23.873268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 636/1247] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:23.878418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44127-a541-4fd9-81d2-7aaf7eaa185a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:23.878815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44127-a541-4fd9-81d2-7aaf7eaa185a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:23.879011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f44127-a541-4fd9-81d2-7aaf7eaa185a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:23.885758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:23.897589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b4f44127-a541-4fd9-81d2-7aaf7eaa185a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:23.898880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b4f44127-a541-4fd9-81d2-7aaf7eaa185a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:23.966473 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 612/1248] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:24.240133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aebbe0-848e-48fe-b5c0-f30f0f60a8ff None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:24.258559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:24.341229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5aebbe0-848e-48fe-b5c0-f30f0f60a8ff None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:24.375938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:24.376689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:24.376991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:24.377245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:24.387133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:41:24.391873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:24.393012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:24.394107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 637/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:41:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:24.401253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f44127-a541-4fd9-81d2-7aaf7eaa185a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:24.500950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f44127-a541-4fd9-81d2-7aaf7eaa185a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:24.530112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:24.535077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:24.535679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:24.535962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:24.536298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:24.536941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:24.537248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:24.538614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:24.548450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 613/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:41:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:24.552776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:24.632190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:24.654430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef36a32-5706-46e8-9b15-3c794a0a3fed None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:24.687593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:24.688256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:24.688562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:24.688835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:24.700604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:24.702173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:24.716810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:24.717933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:24.719246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:24.719246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:24.719246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:24.719246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 638/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:41:24.723925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:24.822616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd0302-d933-4017-9110-c1683f1d8df2 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:24.856601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:24.857352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:24.857596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:24.857875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:24.858517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:24.858853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:24.860216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:24.871962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 614/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:24.877748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:24.977142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16df3f-bb2d-4e94-82af-cfa3a38cf2da None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:25.002915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:25.010955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:25.011581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:25.011865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:25.012143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:25.019522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:25.020976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:41:25.032475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:25.033916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:25.034927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 639/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:25.039793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:25.097612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:25.140790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee09ac-6228-4d0a-be82-f41776b68055 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:25.174596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:25.175378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:25.175710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:25.176039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:25.176820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:25.177178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:25.178691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:25.195181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 615/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 06:41:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:25.201478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:25.300451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cdf452-503c-4583-a107-b66c75d3daf7 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:25.333008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:25.333613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:25.333888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:25.334161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:25.387841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:25.399479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:25.401542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:25.496285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 640/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:41:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:25.502086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:25.601553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ccb90c-f2c7-4296-bad3-fff1a4cdb0f6 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:25.615137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:25.636433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:25.637063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:25.637343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:25.637616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:25.647323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:25.648692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:25.662717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:25.663910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:25.664979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:25.664979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:25.664979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:25.664979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 616/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:25.669686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:25.759085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:25.772055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78981d1-0cdd-431c-8c82-f9c171857875 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:25.805051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:25.805668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:25.806230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:25.806609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:25.807999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:25.808666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:25.810063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:25.821214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 641/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:25.827884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:25.928153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0728587-d8dd-4076-aa48-0e422bc35de3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:25.963523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:25.965594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:25.965594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:25.965594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:25.971363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:25.972814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:41:25.985239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:25.986411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:25.987391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 617/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:41:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 24 06:41:25.992495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:26.092582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8debfac2-1a10-4752-9369-2911b652096e None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:26.125515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d99622-c844-4854-a48f-7f24e4556a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:26.126117 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99622-c844-4854-a48f-7f24e4556a4b None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:26.126393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99622-c844-4854-a48f-7f24e4556a4b None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:26.126664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d99622-c844-4854-a48f-7f24e4556a4b None admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:26.127378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99622-c844-4854-a48f-7f24e4556a4b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:26.127681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99622-c844-4854-a48f-7f24e4556a4b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:26.129100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d99622-c844-4854-a48f-7f24e4556a4b None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:26.141302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 642/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:41:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:26.147433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:26.177097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:26.253473 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560e095-4516-467d-a97a-53cb6b588635 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:26.286206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80321eb-4ad4-4f6d-a1da-3170471cae69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:26.286817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80321eb-4ad4-4f6d-a1da-3170471cae69 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:26.287100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80321eb-4ad4-4f6d-a1da-3170471cae69 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:26.287367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80321eb-4ad4-4f6d-a1da-3170471cae69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:26.288102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80321eb-4ad4-4f6d-a1da-3170471cae69 None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=1c15217a015c4214b6769393fe48c1dd) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:26.288405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80321eb-4ad4-4f6d-a1da-3170471cae69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:26.289818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80321eb-4ad4-4f6d-a1da-3170471cae69 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:26.295084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 618/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:41:26 2022] GET /identity/v3/role_assignments?user.id=1c15217a015c4214b6769393fe48c1dd&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:28.148516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72d3c-b400-4263-8631-cefe3c89bce1 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:28.149095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72d3c-b400-4263-8631-cefe3c89bce1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:28.149095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e72d3c-b400-4263-8631-cefe3c89bce1 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:28.151086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 643/1261] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:28.156396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14467eb0-54b5-41b0-b454-73a92c6685ca None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:28.156832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14467eb0-54b5-41b0-b454-73a92c6685ca None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:28.156937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14467eb0-54b5-41b0-b454-73a92c6685ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:28.175674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-14467eb0-54b5-41b0-b454-73a92c6685ca None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:28.176885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-14467eb0-54b5-41b0-b454-73a92c6685ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:28.242492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 619/1262] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:28.508052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e72d3c-b400-4263-8631-cefe3c89bce1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:28.519337 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:28.612480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e72d3c-b400-4263-8631-cefe3c89bce1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:28.646808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:28.647448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:28.647730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:28.648005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:28.658885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:41:28.663731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:28.664837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:28.665888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 644/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:41:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:28.671110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14467eb0-54b5-41b0-b454-73a92c6685ca None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:28.690615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:28.770215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14467eb0-54b5-41b0-b454-73a92c6685ca None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:28.804762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:28.805369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:28.805652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:28.805929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:28.807253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:28.807562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:28.808934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:28.816850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 620/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:41:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:28.822735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:28.889482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:28.922244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc7a86c-a4b7-45d8-b61a-df5dd0bc2b4c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:28.958813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:28.959502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:28.959810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:28.960087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:28.970393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:28.971984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:28.986501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:28.987579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:28.988700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:28.988700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:28.988700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:28.988700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 645/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:28.994983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:29.077380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:29.096015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813311f6-79cd-4b4b-ae9b-a421c37b6154 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:29.131680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:29.132283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:29.132567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:29.132850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:29.133497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:29.133809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:29.135237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:29.146675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 621/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:29.152985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:29.248935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dab1b1-b518-4924-ad63-3ba635c5ec38 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:29.267901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:29.281409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:29.282026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:29.282547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:29.282865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:29.291580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:29.293010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:41:29.303768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:29.308045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:29.309256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 646/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:29.310582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:29.406452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b2125f-ca49-433f-b3c1-69d6eacbc756 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:29.439067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:29.439714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:29.439999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:29.440274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:29.441001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:29.441312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:29.442748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:29.452760 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:29.460525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 622/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 06:41:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:29.466752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:29.567426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b5d02-cfa4-440a-b22c-a5fae94a4b8c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:29.601044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:29.601667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:29.601948 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:29.602224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:29.612419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:29.613865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:29.627422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:29.628555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:29.629490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:29.629490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:29.629490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:29.629490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 647/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:29.635003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:29.734216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9501d-32c9-4ccc-963f-034f94476db3 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:29.767804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:29.768413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:29.768691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:29.768964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:29.769603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:29.769901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:29.771287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:29.786423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 623/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:29.792309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:29.824481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:29.893162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b405ac01-d035-4501-be08-d5d0ee03817c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:29.927902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:29.928536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:29.928819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:29.929095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:29.936240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:29.937723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:41:29.949308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:29.950440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:29.951689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 648/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:41:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:29.956894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:30.017450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:30.058673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f334cb23-ee6d-481e-b9cf-94d1d1833429 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:30.092216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70babef6-7f40-46e2-b7a3-29c02b75d946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:30.092820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babef6-7f40-46e2-b7a3-29c02b75d946 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:30.093102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babef6-7f40-46e2-b7a3-29c02b75d946 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:30.093375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70babef6-7f40-46e2-b7a3-29c02b75d946 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:30.094064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70babef6-7f40-46e2-b7a3-29c02b75d946 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:30.094369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70babef6-7f40-46e2-b7a3-29c02b75d946 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:30.095871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70babef6-7f40-46e2-b7a3-29c02b75d946 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:30.107564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 624/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:41:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:30.113806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:30.214658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:30.223073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa192b-724d-42ce-9ff9-140b2627f521 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:30.255430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058541db-0d01-4e44-9d0d-14ce093d1407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:30.256083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058541db-0d01-4e44-9d0d-14ce093d1407 None admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:30.256367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058541db-0d01-4e44-9d0d-14ce093d1407 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:30.256858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058541db-0d01-4e44-9d0d-14ce093d1407 None admin] PATH_INFO: `/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/1c15217a015c4214b6769393fe48c1dd/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:30.259259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058541db-0d01-4e44-9d0d-14ce093d1407 None admin] RBAC: Authorizing `identity:create_grant(project_id=33bdcbe43e864e39b976072f52085dc0, user_id=1c15217a015c4214b6769393fe48c1dd, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:30.261280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058541db-0d01-4e44-9d0d-14ce093d1407 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:30.332030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 649/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Wed Aug 24 06:41:30 2022] PUT /identity/v3/projects/33bdcbe43e864e39b976072f52085dc0/users/1c15217a015c4214b6769393fe48c1dd/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:41:32.232193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2191f-3a32-4401-8dfc-d3a9a9e1b853 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:32.232726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2191f-3a32-4401-8dfc-d3a9a9e1b853 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:32.232814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2191f-3a32-4401-8dfc-d3a9a9e1b853 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:32.234338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 625/1274] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:32.239612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa84ef-f870-405a-9960-bf329231eb7e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:32.240044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa84ef-f870-405a-9960-bf329231eb7e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:32.240169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa84ef-f870-405a-9960-bf329231eb7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:32.258369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c4fa84ef-f870-405a-9960-bf329231eb7e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:32.262870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c4fa84ef-f870-405a-9960-bf329231eb7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:32.325197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 650/1275] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:32.594221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2191f-3a32-4401-8dfc-d3a9a9e1b853 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:32.696872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c2191f-3a32-4401-8dfc-d3a9a9e1b853 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:32.715251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:32.731938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:32.732566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:32.732847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:32.733123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:32.745525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 24 06:41:32.750177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:32.751290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:32.752324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 626/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Wed Aug 24 06:41:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:32.757323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa84ef-f870-405a-9960-bf329231eb7e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:32.841549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:32.859335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa84ef-f870-405a-9960-bf329231eb7e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:32.892272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:32.892879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:32.893164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:32.893439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:32.894108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:32.894410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:32.895945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:32.904838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 651/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Wed Aug 24 06:41:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:41:32.910831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:33.008662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b176103-1886-44e5-a739-7627d83cb560 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:33.043047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:33.043682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:33.043964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:33.044243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:33.054062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:33.055624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:33.069666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:33.072592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:33.073531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:33.073531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:33.073531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:33.073531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 627/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:33.076891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:33.179103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a4fa79-65ad-4b2a-bb0d-ac64eb83a596 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:33.211384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:33.211991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:33.212809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:33.213085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:33.213719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:33.214025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:33.215427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:33.226742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 652/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:33.233229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:33.264077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:33.334000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58918d9-b875-49a0-bfaa-60868446fd5a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:33.367683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:33.368461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:33.368664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:33.368939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:33.376385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:33.377814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 24 06:41:33.389178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:33.390289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:33.391643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 628/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:33.396259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:33.400618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:33.492040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2d0647-b172-47d3-880d-cfa13b3c90f4 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:33.527409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:33.528014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:33.528294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:33.528566 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:33.529313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:33.529614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:33.531149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:33.547726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 653/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Wed Aug 24 06:41:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:33.553835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:33.642834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:33.652949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc1db44-e164-4080-a712-96595b15ef2f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:33.688436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:33.689043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:33.689325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:33.689600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:33.757676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:33.759723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:33.845938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:33.856220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 629/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Wed Aug 24 06:41:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 24 06:41:33.862005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:33.923396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:33.962205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd02e57-6621-42d8-89d0-90e3fbf5bf1c None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:33.997982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:33.998651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:33.998927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:33.999200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:34.009745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:34.011202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 24 06:41:34.024991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:34.026538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 24 06:41:34.027689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 24 06:41:34.027689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 24 06:41:34.027689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:34.027689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 654/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:34.031935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:34.132229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e738cfac-df1c-4f12-8cca-ded29c11f6ca None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:34.166593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:34.167471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:34.167759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:34.168039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:34.168687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:34.168995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:34.170448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:34.183737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 630/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Wed Aug 24 06:41:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:41:34.191181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:34.286012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb297891-0659-45ef-a228-6c361f2f64af None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:34.300272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:34.320473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:34.321097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:34.321377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:34.321651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:34.328413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:34.329847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 24 06:41:34.340682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:34.341809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: ERROR keystone.server.flask.application Aug 24 06:41:34.343055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 655/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Wed Aug 24 06:41:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:34.347697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:34.396279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:34.445584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4e32aa-3015-447b-9ae1-7359ce7de9cd None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:34.479455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0410159e-bc22-4e97-b617-e4c77eb29f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:34.480059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410159e-bc22-4e97-b617-e4c77eb29f22 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:34.480342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410159e-bc22-4e97-b617-e4c77eb29f22 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:34.480640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0410159e-bc22-4e97-b617-e4c77eb29f22 None admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:34.481522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410159e-bc22-4e97-b617-e4c77eb29f22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:34.481831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410159e-bc22-4e97-b617-e4c77eb29f22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:34.483288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0410159e-bc22-4e97-b617-e4c77eb29f22 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:34.495076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 631/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Wed Aug 24 06:41:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:34.501228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:34.599896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f22eac-9ed3-434e-90cb-77b031faa8d1 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:34.632869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aecb835-67b5-49f0-85d5-a6e9f85bcd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:34.633523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecb835-67b5-49f0-85d5-a6e9f85bcd9d None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:34.633831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecb835-67b5-49f0-85d5-a6e9f85bcd9d None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:34.634105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aecb835-67b5-49f0-85d5-a6e9f85bcd9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:34.634857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecb835-67b5-49f0-85d5-a6e9f85bcd9d None admin] RBAC: Adding query filter params (role.id=91a8c0dd9a24482f9ba51352671aa49a, scope.project.id=33bdcbe43e864e39b976072f52085dc0, user.id=1c15217a015c4214b6769393fe48c1dd) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:34.635166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecb835-67b5-49f0-85d5-a6e9f85bcd9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:34.636601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aecb835-67b5-49f0-85d5-a6e9f85bcd9d None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:34.642328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 656/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Wed Aug 24 06:41:34 2022] GET /identity/v3/role_assignments?user.id=1c15217a015c4214b6769393fe48c1dd&scope.project.id=33bdcbe43e864e39b976072f52085dc0&role.id=91a8c0dd9a24482f9ba51352671aa49a => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:36.580395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f421c-a468-46e4-9dd4-9270b5ba5ecc None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:36.581015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f421c-a468-46e4-9dd4-9270b5ba5ecc None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:36.581015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f421c-a468-46e4-9dd4-9270b5ba5ecc None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:36.582308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 632/1288] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:36.588038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0c93-4450-4624-89f9-078854dbf0b9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:36.588555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0c93-4450-4624-89f9-078854dbf0b9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:36.588555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe0c93-4450-4624-89f9-078854dbf0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:36.608059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a7fe0c93-4450-4624-89f9-078854dbf0b9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:36.609272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a7fe0c93-4450-4624-89f9-078854dbf0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:36.640166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:36.680038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 657/1289] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:36.949147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f421c-a468-46e4-9dd4-9270b5ba5ecc None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:37.064884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f421c-a468-46e4-9dd4-9270b5ba5ecc None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:37.078911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:37.102870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:37.103522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:37.103803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:37.104079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] PATH_INFO: `/v3/services/placement` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:37.104677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:37.106064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:37.115601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:37.116998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:37.117883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 633/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:41:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:37.123551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0c93-4450-4624-89f9-078854dbf0b9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:37.237509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe0c93-4450-4624-89f9-078854dbf0b9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:37.276724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f46607-724a-44c1-b3c9-999b26cc9cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:37.277347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46607-724a-44c1-b3c9-999b26cc9cfd None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:37.277628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46607-724a-44c1-b3c9-999b26cc9cfd None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:37.277903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f46607-724a-44c1-b3c9-999b26cc9cfd None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:37.278547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f46607-724a-44c1-b3c9-999b26cc9cfd None admin] RBAC: Adding query filter params (name=placement) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:37.278875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f46607-724a-44c1-b3c9-999b26cc9cfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:37.280273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f46607-724a-44c1-b3c9-999b26cc9cfd None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:37.286240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 658/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 06:41:37 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:37.293063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:37.419980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de5d9-7ef2-4f14-989c-a58d6c6eae0f None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:37.455609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb22fcc1-60a9-43d6-8ce8-1cbbdb45b804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:37.456216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22fcc1-60a9-43d6-8ce8-1cbbdb45b804 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:37.456498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22fcc1-60a9-43d6-8ce8-1cbbdb45b804 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:37.456775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22fcc1-60a9-43d6-8ce8-1cbbdb45b804 None admin] PATH_INFO: `/v3/services` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:37.457402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22fcc1-60a9-43d6-8ce8-1cbbdb45b804 None admin] RBAC: Adding query filter params (type=placement) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:37.457702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22fcc1-60a9-43d6-8ce8-1cbbdb45b804 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:37.459102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb22fcc1-60a9-43d6-8ce8-1cbbdb45b804 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:37.470132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 634/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 06:41:37 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:39.437329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7d64-58a3-45d3-88e7-4d1bd942f8e6 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:39.437981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7d64-58a3-45d3-88e7-4d1bd942f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:39.437981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6a7d64-58a3-45d3-88e7-4d1bd942f8e6 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:39.439244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 659/1293] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:39.444655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705ae2-2732-44f5-b571-bf61cd299145 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:39.445212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705ae2-2732-44f5-b571-bf61cd299145 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:39.445212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705ae2-2732-44f5-b571-bf61cd299145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:39.465521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d9705ae2-2732-44f5-b571-bf61cd299145 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:39.466735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d9705ae2-2732-44f5-b571-bf61cd299145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:39.498464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:39.535718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 635/1294] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:39.809780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a7d64-58a3-45d3-88e7-4d1bd942f8e6 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:39.846341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:39.921466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6a7d64-58a3-45d3-88e7-4d1bd942f8e6 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:39.955774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431a28c3-08e4-4c1b-ae1c-28598500a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:39.956383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a28c3-08e4-4c1b-ae1c-28598500a4c0 None admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:39.956666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a28c3-08e4-4c1b-ae1c-28598500a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:39.956934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431a28c3-08e4-4c1b-ae1c-28598500a4c0 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:39.957575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a28c3-08e4-4c1b-ae1c-28598500a4c0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:39.959018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431a28c3-08e4-4c1b-ae1c-28598500a4c0 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:40.108985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 660/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Wed Aug 24 06:41:39 2022] POST /identity/v3/services => generated 246 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:41:42.075678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7656d-1a35-4206-af00-d92f8ccc49ed None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:42.076237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7656d-1a35-4206-af00-d92f8ccc49ed None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:42.076237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b7656d-1a35-4206-af00-d92f8ccc49ed None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:42.077584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 636/1296] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:42.083026 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3e130-9bd8-4e8c-8411-a51d8777c6ae None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:42.086213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3e130-9bd8-4e8c-8411-a51d8777c6ae None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:42.086213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3e130-9bd8-4e8c-8411-a51d8777c6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:42.103808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-1ef3e130-9bd8-4e8c-8411-a51d8777c6ae None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:42.105036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1ef3e130-9bd8-4e8c-8411-a51d8777c6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:42.181924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 661/1297] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:42 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:42.445433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7656d-1a35-4206-af00-d92f8ccc49ed None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:42.556407 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b7656d-1a35-4206-af00-d92f8ccc49ed None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:42.589071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:42.589743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:42.590024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:42.590297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] PATH_INFO: `/v3/services/placement` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:42.590905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:42.595316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:42.600946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:42.602752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:42.604085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 637/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:41:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:42.609008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3e130-9bd8-4e8c-8411-a51d8777c6ae None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:42.627559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:42.707496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3e130-9bd8-4e8c-8411-a51d8777c6ae None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:42.741638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:42.742248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:42.742554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:42.742852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:42.743488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] RBAC: Adding query filter params (name=placement) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:42.743788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:42.745176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:42.750097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 662/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 06:41:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:42.756165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:42.788637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:42.856970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e3bb11-8cc6-4f5c-b7a9-9f6006c0d99a None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:42.890815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2b35b5-94bb-4fd7-b81e-e76b78dfe76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:42.891552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b35b5-94bb-4fd7-b81e-e76b78dfe76b None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:42.891877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b35b5-94bb-4fd7-b81e-e76b78dfe76b None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:42.892196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2b35b5-94bb-4fd7-b81e-e76b78dfe76b None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:42.892937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b35b5-94bb-4fd7-b81e-e76b78dfe76b None admin] RBAC: Adding query filter params (interface=public, service_id=8d4b083170184189bf150dd694389303, region_id=RegionOne) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:42.893292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b35b5-94bb-4fd7-b81e-e76b78dfe76b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:42.894689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2b35b5-94bb-4fd7-b81e-e76b78dfe76b None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:42.900214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 638/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Wed Aug 24 06:41:42 2022] GET /identity/v3/endpoints?service_id=8d4b083170184189bf150dd694389303&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:42.906121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:42.990228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:43.007947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6709fba4-be65-4ba9-beda-781664dd6a23 None admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:43.042289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036fa2e-5997-49f9-97ce-96c0f1737c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:43.042928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036fa2e-5997-49f9-97ce-96c0f1737c26 None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:43.043214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036fa2e-5997-49f9-97ce-96c0f1737c26 None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:43.043496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036fa2e-5997-49f9-97ce-96c0f1737c26 None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:43.044170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036fa2e-5997-49f9-97ce-96c0f1737c26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:43.045538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036fa2e-5997-49f9-97ce-96c0f1737c26 None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:43.052201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 663/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Wed Aug 24 06:41:42 2022] GET /identity/v3/services => generated 2191 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:41:44.973851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c2b28-418e-4835-8f4b-74d876cc7a11 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:44.974388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c2b28-418e-4835-8f4b-74d876cc7a11 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:44.974388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1c2b28-418e-4835-8f4b-74d876cc7a11 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:44.975741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 639/1302] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:41:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:41:44.980947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a5e4-1b68-401f-826c-04d216523c4d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:44.981398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a5e4-1b68-401f-826c-04d216523c4d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:44.981499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638a5e4-1b68-401f-826c-04d216523c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:44.999502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-1638a5e4-1b68-401f-826c-04d216523c4d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:41:45.000674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1638a5e4-1b68-401f-826c-04d216523c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:41:45.067684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 664/1303] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:41:44 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 24 06:41:45.338087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c2b28-418e-4835-8f4b-74d876cc7a11 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:45.433829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:45.440577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1c2b28-418e-4835-8f4b-74d876cc7a11 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:45.473394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:45.474028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:45.474301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:45.474579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] PATH_INFO: `/v3/services/placement` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:45.475204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:45.477111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 24 06:41:45.486652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 24 06:41:45.487875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.get_or_create( Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application with Lock( Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self._enter() Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application return self.creator() Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application created_value = creator( Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: ERROR keystone.server.flask.application Aug 24 06:41:45.489113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 640/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Wed Aug 24 06:41:45 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 24 06:41:45.494471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638a5e4-1b68-401f-826c-04d216523c4d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:45.568912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:45.590664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638a5e4-1b68-401f-826c-04d216523c4d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:45.625512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2150e-4648-4285-8d1d-3f1a956a7ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:45.626127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2150e-4648-4285-8d1d-3f1a956a7ebe None admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:45.626413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2150e-4648-4285-8d1d-3f1a956a7ebe None admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:45.626844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2150e-4648-4285-8d1d-3f1a956a7ebe None admin] PATH_INFO: `/v3/services` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:45.629656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2150e-4648-4285-8d1d-3f1a956a7ebe None admin] RBAC: Adding query filter params (name=placement) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:41:45.629656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2150e-4648-4285-8d1d-3f1a956a7ebe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:45.629656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2150e-4648-4285-8d1d-3f1a956a7ebe None admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:45.635451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 665/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Wed Aug 24 06:41:45 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:41:45.641778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:41:45.745990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98af7e03-a6d4-4256-af9f-3c89c0a64742 None admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:41:45.779187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e512569c-aba7-4c36-833c-c45b63156df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:41:45.779793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512569c-aba7-4c36-833c-c45b63156df4 None admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:41:45.780078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512569c-aba7-4c36-833c-c45b63156df4 None admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:41:45.780356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e512569c-aba7-4c36-833c-c45b63156df4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:41:45.781032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512569c-aba7-4c36-833c-c45b63156df4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:41:45.782658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e512569c-aba7-4c36-833c-c45b63156df4 None admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:41:45.862001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 641/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:41:45 2022] POST /identity/v3/endpoints => generated 331 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:41:55.632393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=30 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:41:55.857455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:31.048321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89c0e-11c0-49f5-a978-80019bf15b23 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:31.048797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89c0e-11c0-49f5-a978-80019bf15b23 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:31.049022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f89c0e-11c0-49f5-a978-80019bf15b23 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:31.054205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 666/1307] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:31.058719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea907-4e4f-4edd-8425-fa4f6c6a30a0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:31.060432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea907-4e4f-4edd-8425-fa4f6c6a30a0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:31.061235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acea907-4e4f-4edd-8425-fa4f6c6a30a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:31.176660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-6acea907-4e4f-4edd-8425-fa4f6c6a30a0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:31.177919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6acea907-4e4f-4edd-8425-fa4f6c6a30a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:31.319323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 642/1308] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:31.607269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217ee6-14b2-4b79-8686-4d8710ee27b3 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:31.607821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217ee6-14b2-4b79-8686-4d8710ee27b3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:31.608255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d217ee6-14b2-4b79-8686-4d8710ee27b3 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:31.613238 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 667/1309] 10.222.0.59 () {54 vars in 965 bytes} [Wed Aug 24 06:49:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:31.616919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7037-1554-472f-bf6e-842c03a609d6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:31.617410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7037-1554-472f-bf6e-842c03a609d6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:31.617845 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc7037-1554-472f-bf6e-842c03a609d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:31.708128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d6cc7037-1554-472f-bf6e-842c03a609d6 None None] MFA Rules not processed for user `60b49283ccd0414389601e5e6f339c45`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:31.709685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d6cc7037-1554-472f-bf6e-842c03a609d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:31.740638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:31.816949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217ee6-14b2-4b79-8686-4d8710ee27b3 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:31.819014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9d217ee6-14b2-4b79-8686-4d8710ee27b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:31.827203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 643/1310] 10.222.0.59 () {58 vars in 1062 bytes} [Wed Aug 24 06:49:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:49:31.943690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d217ee6-14b2-4b79-8686-4d8710ee27b3 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:32.025441 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d698968-1f3c-41f1-b1ec-7b96354858f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:32.026067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698968-1f3c-41f1-b1ec-7b96354858f6 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:32.026912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698968-1f3c-41f1-b1ec-7b96354858f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:32.027190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d698968-1f3c-41f1-b1ec-7b96354858f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:32.028809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1d698968-1f3c-41f1-b1ec-7b96354858f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:32.088119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:32.146404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d698968-1f3c-41f1-b1ec-7b96354858f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:32.148024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d698968-1f3c-41f1-b1ec-7b96354858f6 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:32.169311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 668/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:34.420253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76434-18cb-4cc0-b5c0-5c261505a916 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:34.420804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76434-18cb-4cc0-b5c0-5c261505a916 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:34.420804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a76434-18cb-4cc0-b5c0-5c261505a916 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:34.422363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 644/1312] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:34.427963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e26de-a07b-475c-b602-2d3c579e4df2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:34.428532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e26de-a07b-475c-b602-2d3c579e4df2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:34.428532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e26de-a07b-475c-b602-2d3c579e4df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:34.506493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-cc3e26de-a07b-475c-b602-2d3c579e4df2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:34.507753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cc3e26de-a07b-475c-b602-2d3c579e4df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:34.606579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 669/1313] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:34.894789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76434-18cb-4cc0-b5c0-5c261505a916 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:34.896368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-78a76434-18cb-4cc0-b5c0-5c261505a916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:35.001785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a76434-18cb-4cc0-b5c0-5c261505a916 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:35.072535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:35.075096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cae81d-fb50-4fa0-997d-28cdd0cbc56d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:35.075699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae81d-fb50-4fa0-997d-28cdd0cbc56d service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:35.076004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae81d-fb50-4fa0-997d-28cdd0cbc56d service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:35.076275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cae81d-fb50-4fa0-997d-28cdd0cbc56d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:35.077875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-20cae81d-fb50-4fa0-997d-28cdd0cbc56d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:35.186512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cae81d-fb50-4fa0-997d-28cdd0cbc56d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:35.188082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20cae81d-fb50-4fa0-997d-28cdd0cbc56d service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:35.207919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 645/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:37.789855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f3e8-aa07-40e3-9e6c-4a2d79592f8b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:37.790416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f3e8-aa07-40e3-9e6c-4a2d79592f8b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:37.790416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f2f3e8-aa07-40e3-9e6c-4a2d79592f8b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:37.792098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 670/1315] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:37.797699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb307b9-1d2f-44c1-a544-40cd957c1208 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:37.798194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb307b9-1d2f-44c1-a544-40cd957c1208 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:37.798289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb307b9-1d2f-44c1-a544-40cd957c1208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:37.868516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-2bb307b9-1d2f-44c1-a544-40cd957c1208 None None] MFA Rules not processed for user `e0e17fe7e3984d7f92da9fa6d4676d15`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:37.870281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2bb307b9-1d2f-44c1-a544-40cd957c1208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:37.922051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:37.966538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 646/1316] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:37 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:38.255423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f3e8-aa07-40e3-9e6c-4a2d79592f8b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:38.256956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f1f2f3e8-aa07-40e3-9e6c-4a2d79592f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:38.266757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:38.359171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f2f3e8-aa07-40e3-9e6c-4a2d79592f8b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:38.431337 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493fc207-a8c4-4d63-b31b-a51fc66f2124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:38.431947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc207-a8c4-4d63-b31b-a51fc66f2124 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:38.432804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc207-a8c4-4d63-b31b-a51fc66f2124 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:38.433082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493fc207-a8c4-4d63-b31b-a51fc66f2124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:38.434693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-493fc207-a8c4-4d63-b31b-a51fc66f2124 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:38.496978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:38.540783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fc207-a8c4-4d63-b31b-a51fc66f2124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:38.542987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493fc207-a8c4-4d63-b31b-a51fc66f2124 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:38.561773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 671/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:38 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:41.487717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354a5ad-8811-43c7-8ab8-84e1da5305d0 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:41.488291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354a5ad-8811-43c7-8ab8-84e1da5305d0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:41.488291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354a5ad-8811-43c7-8ab8-84e1da5305d0 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:41.489677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 647/1318] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:41.494879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce69a-bfde-4b2f-a5ed-c665815117f8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:41.495325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce69a-bfde-4b2f-a5ed-c665815117f8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:41.495435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ce69a-bfde-4b2f-a5ed-c665815117f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:41.563768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f16ce69a-bfde-4b2f-a5ed-c665815117f8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:41.564985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f16ce69a-bfde-4b2f-a5ed-c665815117f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:41.662430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 672/1319] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:41 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:41.962834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e600f-84fe-4ada-bb6c-8eba8191ae60 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:41.963639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e600f-84fe-4ada-bb6c-8eba8191ae60 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:41.963925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e600f-84fe-4ada-bb6c-8eba8191ae60 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:41.965320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 648/1320] 10.222.0.59 () {54 vars in 965 bytes} [Wed Aug 24 06:49:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:41.971354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e846-68af-49f2-b9af-028f9937c503 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:41.971649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e846-68af-49f2-b9af-028f9937c503 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:41.971933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c7e846-68af-49f2-b9af-028f9937c503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:41.994450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:42.047497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-75c7e846-68af-49f2-b9af-028f9937c503 None None] MFA Rules not processed for user `60b49283ccd0414389601e5e6f339c45`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:42.048730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-75c7e846-68af-49f2-b9af-028f9937c503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:42.123157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 673/1321] 10.222.0.59 () {58 vars in 1062 bytes} [Wed Aug 24 06:49:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:42.132260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e600f-84fe-4ada-bb6c-8eba8191ae60 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:42.133808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a88e600f-84fe-4ada-bb6c-8eba8191ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:42.235460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e600f-84fe-4ada-bb6c-8eba8191ae60 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:42.307523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59932e2b-cad7-43f7-b0e9-03b460f51693 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:42.308124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59932e2b-cad7-43f7-b0e9-03b460f51693 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:42.308406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59932e2b-cad7-43f7-b0e9-03b460f51693 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:42.308678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59932e2b-cad7-43f7-b0e9-03b460f51693 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:42.310287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-59932e2b-cad7-43f7-b0e9-03b460f51693 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:42.317626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:42.417126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59932e2b-cad7-43f7-b0e9-03b460f51693 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:42.418539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59932e2b-cad7-43f7-b0e9-03b460f51693 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:42.436492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 649/1322] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:45.929175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cae903-8f04-460c-8e9f-4520c3d70b34 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:45.929738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cae903-8f04-460c-8e9f-4520c3d70b34 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:45.929738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cae903-8f04-460c-8e9f-4520c3d70b34 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:45.931120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 674/1323] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:45.937227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df11d-860e-4a16-bb03-2380cfaa83f2 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:45.937679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df11d-860e-4a16-bb03-2380cfaa83f2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:45.937808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4df11d-860e-4a16-bb03-2380cfaa83f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:46.004780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ef4df11d-860e-4a16-bb03-2380cfaa83f2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:46.006025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ef4df11d-860e-4a16-bb03-2380cfaa83f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:46.066025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:46.106230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 650/1324] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:46.394312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cae903-8f04-460c-8e9f-4520c3d70b34 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:46.395995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b3cae903-8f04-460c-8e9f-4520c3d70b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:46.504834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cae903-8f04-460c-8e9f-4520c3d70b34 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:46.517539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:46.581187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927ec6f-0a1a-414e-9944-c4cd45be6a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:46.581794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ec6f-0a1a-414e-9944-c4cd45be6a20 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:46.582083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ec6f-0a1a-414e-9944-c4cd45be6a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:46.582358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927ec6f-0a1a-414e-9944-c4cd45be6a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:46.583995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8927ec6f-0a1a-414e-9944-c4cd45be6a20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:46.704440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927ec6f-0a1a-414e-9944-c4cd45be6a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:46.705920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927ec6f-0a1a-414e-9944-c4cd45be6a20 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:46.729369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 675/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:48.785633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4706ca-37af-4ee8-8514-1b155063c57a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:48.786044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4706ca-37af-4ee8-8514-1b155063c57a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:48.786202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4706ca-37af-4ee8-8514-1b155063c57a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:48.787778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 651/1326] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:48.793778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1f87a-8bf6-4527-8472-061779fbe273 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:48.794215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1f87a-8bf6-4527-8472-061779fbe273 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:48.794343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d1f87a-8bf6-4527-8472-061779fbe273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:48.844037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:48.863316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-46d1f87a-8bf6-4527-8472-061779fbe273 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:48.864550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-46d1f87a-8bf6-4527-8472-061779fbe273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:48.968321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 676/1327] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:49.255947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4706ca-37af-4ee8-8514-1b155063c57a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:49.257523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7e4706ca-37af-4ee8-8514-1b155063c57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:49.359713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4706ca-37af-4ee8-8514-1b155063c57a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:49.442173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3de24-cba3-43dd-bada-c32bd70e46de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:49.442821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de24-cba3-43dd-bada-c32bd70e46de service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:49.443108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de24-cba3-43dd-bada-c32bd70e46de service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:49.443383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3de24-cba3-43dd-bada-c32bd70e46de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:49.445034 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8aa3de24-cba3-43dd-bada-c32bd70e46de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:49.462421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:49.556497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3de24-cba3-43dd-bada-c32bd70e46de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:49.558480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3de24-cba3-43dd-bada-c32bd70e46de service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:49.578569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 652/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:51.568535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a37ff-dbde-4453-9b31-d2be04654831 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:51.569050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a37ff-dbde-4453-9b31-d2be04654831 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:51.569158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a37ff-dbde-4453-9b31-d2be04654831 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:51.570429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 677/1329] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:51.576714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767a312-e4fd-49fc-8fa5-a7cabe84d763 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:51.577184 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767a312-e4fd-49fc-8fa5-a7cabe84d763 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:51.577289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767a312-e4fd-49fc-8fa5-a7cabe84d763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:51.655474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8767a312-e4fd-49fc-8fa5-a7cabe84d763 None None] MFA Rules not processed for user `e0e17fe7e3984d7f92da9fa6d4676d15`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:51.656718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8767a312-e4fd-49fc-8fa5-a7cabe84d763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:51.723809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:51.756784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 653/1330] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:51 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:52.042356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a37ff-dbde-4453-9b31-d2be04654831 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:52.043985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8f0a37ff-dbde-4453-9b31-d2be04654831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:52.156345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a37ff-dbde-4453-9b31-d2be04654831 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:52.176246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:52.228915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f839a56-9cbf-45fb-898d-efb5a367a887 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:52.229541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839a56-9cbf-45fb-898d-efb5a367a887 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:52.229820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839a56-9cbf-45fb-898d-efb5a367a887 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:52.230094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f839a56-9cbf-45fb-898d-efb5a367a887 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:52.231689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2f839a56-9cbf-45fb-898d-efb5a367a887 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:52.341119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839a56-9cbf-45fb-898d-efb5a367a887 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:52.342565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f839a56-9cbf-45fb-898d-efb5a367a887 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:52.360866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 678/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:52 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:54.791480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402d1a5-6d98-4500-b6d3-0d2ea4a4f1c7 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:54.791887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402d1a5-6d98-4500-b6d3-0d2ea4a4f1c7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:54.792081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4402d1a5-6d98-4500-b6d3-0d2ea4a4f1c7 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:54.793481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 654/1332] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:54.800693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574846b-1b0b-4854-ad55-145bd8d597ae None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:54.800693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574846b-1b0b-4854-ad55-145bd8d597ae None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:54.800693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574846b-1b0b-4854-ad55-145bd8d597ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:54.867673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:54.870312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4574846b-1b0b-4854-ad55-145bd8d597ae None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:54.871715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4574846b-1b0b-4854-ad55-145bd8d597ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:54.973698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 679/1333] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:55.256001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402d1a5-6d98-4500-b6d3-0d2ea4a4f1c7 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:55.257530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4402d1a5-6d98-4500-b6d3-0d2ea4a4f1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:55.359277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4402d1a5-6d98-4500-b6d3-0d2ea4a4f1c7 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:55.430734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a2629a-9708-450d-9dcf-7b239ee7b67b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:55.431362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2629a-9708-450d-9dcf-7b239ee7b67b service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:55.431648 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2629a-9708-450d-9dcf-7b239ee7b67b service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:55.432433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2629a-9708-450d-9dcf-7b239ee7b67b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:55.434057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-74a2629a-9708-450d-9dcf-7b239ee7b67b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:55.460523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:55.542966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2629a-9708-450d-9dcf-7b239ee7b67b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:55.544401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a2629a-9708-450d-9dcf-7b239ee7b67b service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:55.563102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 655/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:49:57.500095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca5744-6b19-46f7-9ff5-bb18efdc7b15 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:57.500694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca5744-6b19-46f7-9ff5-bb18efdc7b15 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:57.500694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca5744-6b19-46f7-9ff5-bb18efdc7b15 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:57.502028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 680/1335] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:49:57.507606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1f202-f1fd-49fd-9182-4b05c5a4a3f1 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:57.508017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1f202-f1fd-49fd-9182-4b05c5a4a3f1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:57.508165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1f202-f1fd-49fd-9182-4b05c5a4a3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:57.572861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-51b1f202-f1fd-49fd-9182-4b05c5a4a3f1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:49:57.574236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-51b1f202-f1fd-49fd-9182-4b05c5a4a3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:57.647645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:57.671022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 656/1336] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:49:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:49:57.955959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca5744-6b19-46f7-9ff5-bb18efdc7b15 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:49:57.957508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c2ca5744-6b19-46f7-9ff5-bb18efdc7b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:58.066168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca5744-6b19-46f7-9ff5-bb18efdc7b15 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:49:58.095101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:49:58.140939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7f32d2-b3fe-4477-ab84-e8c3d9e3f9b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:49:58.144517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f32d2-b3fe-4477-ab84-e8c3d9e3f9b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:49:58.144517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f32d2-b3fe-4477-ab84-e8c3d9e3f9b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:49:58.144517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7f32d2-b3fe-4477-ab84-e8c3d9e3f9b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:49:58.144517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1d7f32d2-b3fe-4477-ab84-e8c3d9e3f9b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:49:58.251306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f32d2-b3fe-4477-ab84-e8c3d9e3f9b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:49:58.252716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7f32d2-b3fe-4477-ab84-e8c3d9e3f9b9 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:49:58.272809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 681/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:49:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:00.896140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7983-e4e1-416f-9268-f6af0106ad97 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:00.896722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7983-e4e1-416f-9268-f6af0106ad97 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:00.896722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15b7983-e4e1-416f-9268-f6af0106ad97 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:00.898186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 657/1338] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:00.904120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73e81-5634-41b1-92c9-02ff0cbe9bb6 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:00.904573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73e81-5634-41b1-92c9-02ff0cbe9bb6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:00.904679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b73e81-5634-41b1-92c9-02ff0cbe9bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:00.970866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-57b73e81-5634-41b1-92c9-02ff0cbe9bb6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:00.972124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-57b73e81-5634-41b1-92c9-02ff0cbe9bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:00.980477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:01.070947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 682/1339] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:01.349454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b7983-e4e1-416f-9268-f6af0106ad97 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:01.351114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f15b7983-e4e1-416f-9268-f6af0106ad97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:01.455145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15b7983-e4e1-416f-9268-f6af0106ad97 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:01.526148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b45933-8793-4975-b34d-04cad6bc3663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:01.527335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45933-8793-4975-b34d-04cad6bc3663 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:01.527611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45933-8793-4975-b34d-04cad6bc3663 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:01.527882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b45933-8793-4975-b34d-04cad6bc3663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:01.529487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c7b45933-8793-4975-b34d-04cad6bc3663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:01.564537 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:01.638125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b45933-8793-4975-b34d-04cad6bc3663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:01.639514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b45933-8793-4975-b34d-04cad6bc3663 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:01.658568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 658/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:01 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:05.972242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff016c-263e-4ef8-94e3-f7c6f963eff5 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:05.973010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff016c-263e-4ef8-94e3-f7c6f963eff5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:05.973010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff016c-263e-4ef8-94e3-f7c6f963eff5 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:05.974488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 683/1341] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:05.980158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a095b-8a83-4c34-b416-f9c4758c3a7d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:05.980628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a095b-8a83-4c34-b416-f9c4758c3a7d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:05.980721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828a095b-8a83-4c34-b416-f9c4758c3a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:06.052241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-828a095b-8a83-4c34-b416-f9c4758c3a7d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:06.053527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-828a095b-8a83-4c34-b416-f9c4758c3a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:06.140826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:06.156053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 659/1342] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:06.440151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff016c-263e-4ef8-94e3-f7c6f963eff5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:06.441694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-55ff016c-263e-4ef8-94e3-f7c6f963eff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:06.548345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff016c-263e-4ef8-94e3-f7c6f963eff5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:06.587714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:06.624825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e657c959-5631-4354-8a20-12c1bfc4887d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:06.625437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657c959-5631-4354-8a20-12c1bfc4887d service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:06.625724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657c959-5631-4354-8a20-12c1bfc4887d service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:06.625998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e657c959-5631-4354-8a20-12c1bfc4887d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:06.627655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e657c959-5631-4354-8a20-12c1bfc4887d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:06.748905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657c959-5631-4354-8a20-12c1bfc4887d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:06.750353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e657c959-5631-4354-8a20-12c1bfc4887d service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:06.769099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 684/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:09.674954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7e786-ab72-44ab-85bf-57205f911093 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:09.675486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7e786-ab72-44ab-85bf-57205f911093 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:09.675607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7e786-ab72-44ab-85bf-57205f911093 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:09.676891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 660/1344] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:09.682345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cae30-ab18-4df1-bc82-4a6494c1f864 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:09.682859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cae30-ab18-4df1-bc82-4a6494c1f864 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:09.687255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cae30-ab18-4df1-bc82-4a6494c1f864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:09.755652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a97cae30-ab18-4df1-bc82-4a6494c1f864 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:09.756780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a97cae30-ab18-4df1-bc82-4a6494c1f864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:09.775590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:09.856558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 685/1345] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:50:10.138017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7e786-ab72-44ab-85bf-57205f911093 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:10.139660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-efc7e786-ab72-44ab-85bf-57205f911093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:10.250001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7e786-ab72-44ab-85bf-57205f911093 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:10.327603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb0a8e7-0e69-4e1c-b862-0602e5cdbdf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:10.328221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a8e7-0e69-4e1c-b862-0602e5cdbdf5 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:10.328506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a8e7-0e69-4e1c-b862-0602e5cdbdf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:10.328781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb0a8e7-0e69-4e1c-b862-0602e5cdbdf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:10.330403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bdb0a8e7-0e69-4e1c-b862-0602e5cdbdf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:10.375749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:10.443472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a8e7-0e69-4e1c-b862-0602e5cdbdf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:10.444960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb0a8e7-0e69-4e1c-b862-0602e5cdbdf5 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:10.464062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 661/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:14.698364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3206-26ec-4f89-9804-c480a209551c None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:14.698917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3206-26ec-4f89-9804-c480a209551c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:14.699051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3206-26ec-4f89-9804-c480a209551c None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:14.700298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 686/1347] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:14.706163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f93c-9e6a-40e4-8e0f-00694da8a0d3 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:14.710994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f93c-9e6a-40e4-8e0f-00694da8a0d3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:14.710994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf8f93c-9e6a-40e4-8e0f-00694da8a0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:14.779935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0cf8f93c-9e6a-40e4-8e0f-00694da8a0d3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:14.781162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0cf8f93c-9e6a-40e4-8e0f-00694da8a0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:14.896813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:14.899642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 662/1348] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:15.193346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3206-26ec-4f89-9804-c480a209551c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:15.195227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b00e3206-26ec-4f89-9804-c480a209551c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:15.319897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3206-26ec-4f89-9804-c480a209551c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:15.372776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:15.399758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaf1e85-8ee9-4966-bea9-ad1991eab5c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:15.400438 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1e85-8ee9-4966-bea9-ad1991eab5c1 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:15.401263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1e85-8ee9-4966-bea9-ad1991eab5c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:15.401540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaf1e85-8ee9-4966-bea9-ad1991eab5c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:15.403197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cbaf1e85-8ee9-4966-bea9-ad1991eab5c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:15.511118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf1e85-8ee9-4966-bea9-ad1991eab5c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:15.512560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaf1e85-8ee9-4966-bea9-ad1991eab5c1 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:15.531325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 687/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:20.537305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3329c-6abe-4c34-b9dc-c49f10811a2a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:20.537805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3329c-6abe-4c34-b9dc-c49f10811a2a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:20.537886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a3329c-6abe-4c34-b9dc-c49f10811a2a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:20.539292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 663/1350] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 06:50:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:20.545424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615348-7eaa-4b72-9178-5097b3453fe2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:20.545891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615348-7eaa-4b72-9178-5097b3453fe2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:20.545974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a615348-7eaa-4b72-9178-5097b3453fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:20.665040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-7a615348-7eaa-4b72-9178-5097b3453fe2 None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:20.669771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7a615348-7eaa-4b72-9178-5097b3453fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:20.723825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:20.849577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 688/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 06:50:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:25.057893 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b27c-ca94-40a8-9199-61c6b68cfedd None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:25.058550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b27c-ca94-40a8-9199-61c6b68cfedd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:25.058550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d687b27c-ca94-40a8-9199-61c6b68cfedd None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:25.060144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 664/1352] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 06:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:25.066874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee5b9-8254-476d-9846-de24a743e056 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:25.067351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee5b9-8254-476d-9846-de24a743e056 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:25.067444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ee5b9-8254-476d-9846-de24a743e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:25.148902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-7a7ee5b9-8254-476d-9846-de24a743e056 None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:25.150135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7a7ee5b9-8254-476d-9846-de24a743e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:25.232088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:25.270406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 689/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 06:50:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:26.710141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7002-1b23-44dd-b933-dfc52755e419 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:26.710683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7002-1b23-44dd-b933-dfc52755e419 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:26.710683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a7002-1b23-44dd-b933-dfc52755e419 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:26.712399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 665/1354] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 06:50:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:26.718475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbd6a-d16e-405a-beeb-e21f3fdcd19f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:26.718938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbd6a-d16e-405a-beeb-e21f3fdcd19f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:26.719080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5cbd6a-d16e-405a-beeb-e21f3fdcd19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:26.797413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-bb5cbd6a-d16e-405a-beeb-e21f3fdcd19f None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:26.798635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bb5cbd6a-d16e-405a-beeb-e21f3fdcd19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:26.905109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 690/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 06:50:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:30.309047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b45a4-6baa-4ae1-af8d-599c120d9f8d None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:30.309591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b45a4-6baa-4ae1-af8d-599c120d9f8d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:30.309591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479b45a4-6baa-4ae1-af8d-599c120d9f8d None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:30.310959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 666/1356] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:30.316279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e40598-e551-4cc1-9aa7-834bdf47814f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:30.316689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e40598-e551-4cc1-9aa7-834bdf47814f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:30.316834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e40598-e551-4cc1-9aa7-834bdf47814f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:30.368977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:30.406212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-15e40598-e551-4cc1-9aa7-834bdf47814f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:30.407436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-15e40598-e551-4cc1-9aa7-834bdf47814f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:30.546232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 691/1357] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:30.849140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794367-84fb-4323-9adb-962b8e642cff None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:30.849925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794367-84fb-4323-9adb-962b8e642cff None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:30.850516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33794367-84fb-4323-9adb-962b8e642cff None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:30.852265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 667/1358] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 06:50:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:30.859981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09b15-6b95-4ca0-bae8-b9563c9419e5 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:30.860849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09b15-6b95-4ca0-bae8-b9563c9419e5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:30.861377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a09b15-6b95-4ca0-bae8-b9563c9419e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:30.955189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-78a09b15-6b95-4ca0-bae8-b9563c9419e5 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:30.957049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-78a09b15-6b95-4ca0-bae8-b9563c9419e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:31.012397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:31.086967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 692/1359] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 06:50:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:50:31.096949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794367-84fb-4323-9adb-962b8e642cff None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:31.098658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-33794367-84fb-4323-9adb-962b8e642cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:31.258201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33794367-84fb-4323-9adb-962b8e642cff None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:31.354336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:31.395382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7446ca7a-7f48-4b7a-b12e-442ceae35ac8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:31.395994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ca7a-7f48-4b7a-b12e-442ceae35ac8 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:31.396276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ca7a-7f48-4b7a-b12e-442ceae35ac8 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:31.396548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446ca7a-7f48-4b7a-b12e-442ceae35ac8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:31.398206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7446ca7a-7f48-4b7a-b12e-442ceae35ac8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:31.491524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446ca7a-7f48-4b7a-b12e-442ceae35ac8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:31.493102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7446ca7a-7f48-4b7a-b12e-442ceae35ac8 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:31.512526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 668/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:33.659644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389bcab-780f-4947-8daf-eed8bb7dc59b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:33.660172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389bcab-780f-4947-8daf-eed8bb7dc59b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:33.660172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a389bcab-780f-4947-8daf-eed8bb7dc59b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:33.661611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 693/1361] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:33.668983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f61d7-bc8e-4657-a56a-1186c1d407c5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:33.669583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f61d7-bc8e-4657-a56a-1186c1d407c5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:33.669583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f61d7-bc8e-4657-a56a-1186c1d407c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:33.740494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-097f61d7-bc8e-4657-a56a-1186c1d407c5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:33.741710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-097f61d7-bc8e-4657-a56a-1186c1d407c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:33.780695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:33.844337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 669/1362] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:34.150932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389bcab-780f-4947-8daf-eed8bb7dc59b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:34.152541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a389bcab-780f-4947-8daf-eed8bb7dc59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:34.310522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a389bcab-780f-4947-8daf-eed8bb7dc59b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:34.321535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:34.431991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36acc4af-0255-4f66-94a3-6244c62cc294 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:34.432783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acc4af-0255-4f66-94a3-6244c62cc294 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:34.433170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acc4af-0255-4f66-94a3-6244c62cc294 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:34.433546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36acc4af-0255-4f66-94a3-6244c62cc294 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:34.435323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-36acc4af-0255-4f66-94a3-6244c62cc294 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:34.534059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acc4af-0255-4f66-94a3-6244c62cc294 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:34.535710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36acc4af-0255-4f66-94a3-6244c62cc294 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:34.555284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 694/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:50:36.949412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c470a3f-5953-450a-a78a-d3b4fb060144 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:36.950432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c470a3f-5953-450a-a78a-d3b4fb060144 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:36.950989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c470a3f-5953-450a-a78a-d3b4fb060144 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:36.952569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 670/1364] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:36.958344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109c26-eb97-44ed-b850-55b38f7965b1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:36.959248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109c26-eb97-44ed-b850-55b38f7965b1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:36.959721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109c26-eb97-44ed-b850-55b38f7965b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:36.976958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:37.032338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-b3109c26-eb97-44ed-b850-55b38f7965b1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:37.033557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b3109c26-eb97-44ed-b850-55b38f7965b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:37.138806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 695/1365] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:37.435450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00bfc-9682-4aa2-ba6a-024376a6a45d None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:37.436483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00bfc-9682-4aa2-ba6a-024376a6a45d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:37.436795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d00bfc-9682-4aa2-ba6a-024376a6a45d None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:37.438410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 671/1366] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 06:50:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:37.444252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a823-0b48-4331-9892-ca983de33033 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:37.450016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a823-0b48-4331-9892-ca983de33033 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:37.450016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b07a823-0b48-4331-9892-ca983de33033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:37.528937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-1b07a823-0b48-4331-9892-ca983de33033 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:37.530342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1b07a823-0b48-4331-9892-ca983de33033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:37.568056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:37.653193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 696/1367] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 06:50:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:37.661703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d00bfc-9682-4aa2-ba6a-024376a6a45d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:37.663394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-97d00bfc-9682-4aa2-ba6a-024376a6a45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:37.832023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d00bfc-9682-4aa2-ba6a-024376a6a45d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:37.853554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:37.951947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea1e9c0-6852-45ee-8cf9-7373554bed66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:37.952762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e9c0-6852-45ee-8cf9-7373554bed66 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:37.953180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e9c0-6852-45ee-8cf9-7373554bed66 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:37.953569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea1e9c0-6852-45ee-8cf9-7373554bed66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:37.955375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2ea1e9c0-6852-45ee-8cf9-7373554bed66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:38.057637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1e9c0-6852-45ee-8cf9-7373554bed66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:38.059279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea1e9c0-6852-45ee-8cf9-7373554bed66 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:38.084912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 672/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:50:38.611732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3243a7-72c9-4ae6-8d59-323470c976a5 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:38.612271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3243a7-72c9-4ae6-8d59-323470c976a5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:38.612271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3243a7-72c9-4ae6-8d59-323470c976a5 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:38.613873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 697/1369] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:38.619662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e76ef-9b83-43e9-872c-1b2d8b8f5f18 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:38.622971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e76ef-9b83-43e9-872c-1b2d8b8f5f18 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:38.622971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9e76ef-9b83-43e9-872c-1b2d8b8f5f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:38.655024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:38.707001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-be9e76ef-9b83-43e9-872c-1b2d8b8f5f18 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:38.708517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-be9e76ef-9b83-43e9-872c-1b2d8b8f5f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:38.827273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 673/1370] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:39.406515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d7428-bd15-4a5c-917b-e12021b26c77 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:39.406515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d7428-bd15-4a5c-917b-e12021b26c77 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:39.408865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005d7428-bd15-4a5c-917b-e12021b26c77 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:39.408865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 698/1371] 10.222.0.59 () {54 vars in 964 bytes} [Wed Aug 24 06:50:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:39.414059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de616a-cec3-4235-8169-a50fe66451b9 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:39.414685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de616a-cec3-4235-8169-a50fe66451b9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:39.414685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de616a-cec3-4235-8169-a50fe66451b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:39.501162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c1de616a-cec3-4235-8169-a50fe66451b9 None None] MFA Rules not processed for user `cc7c77697ae44017bfb40f9c77ffea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:39.502556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c1de616a-cec3-4235-8169-a50fe66451b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:39.551313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:39.582931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 674/1372] 10.222.0.59 () {58 vars in 1061 bytes} [Wed Aug 24 06:50:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:39.591331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d7428-bd15-4a5c-917b-e12021b26c77 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:39.592964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-005d7428-bd15-4a5c-917b-e12021b26c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:39.706297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005d7428-bd15-4a5c-917b-e12021b26c77 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:39.754926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:39.791428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937ad472-f84f-435e-998b-0407f937c481 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:39.792039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad472-f84f-435e-998b-0407f937c481 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:39.792319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad472-f84f-435e-998b-0407f937c481 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:39.792591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937ad472-f84f-435e-998b-0407f937c481 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:39.794214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-937ad472-f84f-435e-998b-0407f937c481 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:39.909444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ad472-f84f-435e-998b-0407f937c481 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:39.912155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937ad472-f84f-435e-998b-0407f937c481 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:39.935863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 699/1373] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:50:40.244257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f15b-e7ab-461a-adff-96d79c88c495 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:40.244364 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f15b-e7ab-461a-adff-96d79c88c495 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:40.244613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614f15b-e7ab-461a-adff-96d79c88c495 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:40.246126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 675/1374] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:40.251311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33ec8b-388a-4651-a06e-1f04854b019b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:40.251606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33ec8b-388a-4651-a06e-1f04854b019b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:40.252035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a33ec8b-388a-4651-a06e-1f04854b019b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:40.337869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0a33ec8b-388a-4651-a06e-1f04854b019b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:40.339173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0a33ec8b-388a-4651-a06e-1f04854b019b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:40.359685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:40.440412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 700/1375] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:40.731320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614f15b-e7ab-461a-adff-96d79c88c495 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:40.732770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8614f15b-e7ab-461a-adff-96d79c88c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:40.882582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614f15b-e7ab-461a-adff-96d79c88c495 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:40.933348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:40.999010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba6b74a-630f-4348-90c5-f9a35098f740 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:40.999627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6b74a-630f-4348-90c5-f9a35098f740 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:40.999914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6b74a-630f-4348-90c5-f9a35098f740 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:41.000317 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba6b74a-630f-4348-90c5-f9a35098f740 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:41.001901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3ba6b74a-630f-4348-90c5-f9a35098f740 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:41.094254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6b74a-630f-4348-90c5-f9a35098f740 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:41.095787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba6b74a-630f-4348-90c5-f9a35098f740 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:41.113417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 676/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:43.257182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d528-a973-4dfa-9728-a07add4922a5 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:43.257764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d528-a973-4dfa-9728-a07add4922a5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:43.257764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d343d528-a973-4dfa-9728-a07add4922a5 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:43.259257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 701/1377] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:43.264431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c9629-4ba2-4125-ac26-6a1009ba4198 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:43.264830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c9629-4ba2-4125-ac26-6a1009ba4198 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:43.264990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c9629-4ba2-4125-ac26-6a1009ba4198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:43.331453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0b2c9629-4ba2-4125-ac26-6a1009ba4198 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:43.332668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0b2c9629-4ba2-4125-ac26-6a1009ba4198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:43.339746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:43.432122 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 677/1378] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:43.740321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343d528-a973-4dfa-9728-a07add4922a5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:43.741849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d343d528-a973-4dfa-9728-a07add4922a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:43.898407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d343d528-a973-4dfa-9728-a07add4922a5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:43.902440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:44.023419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86906439-997d-41bc-80b4-3d349fe7d787 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:44.023944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906439-997d-41bc-80b4-3d349fe7d787 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:44.025411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906439-997d-41bc-80b4-3d349fe7d787 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:44.025701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86906439-997d-41bc-80b4-3d349fe7d787 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:44.027333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-86906439-997d-41bc-80b4-3d349fe7d787 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:44.124937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906439-997d-41bc-80b4-3d349fe7d787 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:44.126522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86906439-997d-41bc-80b4-3d349fe7d787 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:44.149582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 702/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:46.252348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42698ff-f080-41e2-a27a-c015d212c206 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:46.253110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42698ff-f080-41e2-a27a-c015d212c206 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:46.253110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42698ff-f080-41e2-a27a-c015d212c206 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:46.254734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 678/1380] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:46.260366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79446a-99de-4929-b4a6-8111e683f98c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:46.260900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79446a-99de-4929-b4a6-8111e683f98c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:46.260900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e79446a-99de-4929-b4a6-8111e683f98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:46.272643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:46.337843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0e79446a-99de-4929-b4a6-8111e683f98c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:46.339104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0e79446a-99de-4929-b4a6-8111e683f98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:46.465685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 703/1381] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:46.775418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42698ff-f080-41e2-a27a-c015d212c206 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:46.777882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c42698ff-f080-41e2-a27a-c015d212c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:46.940134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:46.951747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42698ff-f080-41e2-a27a-c015d212c206 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:47.081871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c44232-b693-4187-9197-39cdb5999295 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:47.082459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c44232-b693-4187-9197-39cdb5999295 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:47.082750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c44232-b693-4187-9197-39cdb5999295 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:47.083067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c44232-b693-4187-9197-39cdb5999295 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:47.084859 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-98c44232-b693-4187-9197-39cdb5999295 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:47.183799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c44232-b693-4187-9197-39cdb5999295 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:47.185413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c44232-b693-4187-9197-39cdb5999295 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:47.197535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:47.206619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 679/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:49.353390 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1727d-9ab2-4071-a8da-c99f9d8c8422 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:49.354000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1727d-9ab2-4071-a8da-c99f9d8c8422 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:49.354143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc1727d-9ab2-4071-a8da-c99f9d8c8422 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:49.356111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 704/1383] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:49.363277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2f03-9572-4526-9b77-70bd468758ac None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:49.363943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2f03-9572-4526-9b77-70bd468758ac None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:49.363943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefa2f03-9572-4526-9b77-70bd468758ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:49.443303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-eefa2f03-9572-4526-9b77-70bd468758ac None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:49.445232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-eefa2f03-9572-4526-9b77-70bd468758ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:49.568606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 680/1384] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:49.885636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1727d-9ab2-4071-a8da-c99f9d8c8422 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:49.886458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8fc1727d-9ab2-4071-a8da-c99f9d8c8422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:49.998656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:50.063641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc1727d-9ab2-4071-a8da-c99f9d8c8422 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:50.203453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec713b-c502-477b-9df8-679ddba9b109 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:50.204129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec713b-c502-477b-9df8-679ddba9b109 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:50.204492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec713b-c502-477b-9df8-679ddba9b109 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:50.204812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec713b-c502-477b-9df8-679ddba9b109 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:50.206688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e7ec713b-c502-477b-9df8-679ddba9b109 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:50.267146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:50.318909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec713b-c502-477b-9df8-679ddba9b109 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:50.321185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ec713b-c502-477b-9df8-679ddba9b109 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:50.345416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 705/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:50:52.376251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2888f81-b394-4e0e-bfa3-e97cd8b4c8d1 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:52.409764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2888f81-b394-4e0e-bfa3-e97cd8b4c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:52.409764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2888f81-b394-4e0e-bfa3-e97cd8b4c8d1 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:52.409764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 681/1386] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:52.410091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1713-775c-439f-a934-618a5b9c4def None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:52.410091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1713-775c-439f-a934-618a5b9c4def None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:52.410091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669d1713-775c-439f-a934-618a5b9c4def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:52.468421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-669d1713-775c-439f-a934-618a5b9c4def None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:52.470198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-669d1713-775c-439f-a934-618a5b9c4def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:52.574277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 706/1387] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:52.870972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2888f81-b394-4e0e-bfa3-e97cd8b4c8d1 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:52.872562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b2888f81-b394-4e0e-bfa3-e97cd8b4c8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:52.959445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:53.054281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2888f81-b394-4e0e-bfa3-e97cd8b4c8d1 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:53.194953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c83ca3-0a29-427a-8245-bc972bec2bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:53.195816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83ca3-0a29-427a-8245-bc972bec2bee service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:53.196185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83ca3-0a29-427a-8245-bc972bec2bee service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:53.196535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c83ca3-0a29-427a-8245-bc972bec2bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:53.198690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-68c83ca3-0a29-427a-8245-bc972bec2bee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:53.249025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:53.309555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c83ca3-0a29-427a-8245-bc972bec2bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:53.311217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c83ca3-0a29-427a-8245-bc972bec2bee service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:53.333854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 682/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:50:55.356130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eb1ab-b95b-4c6b-b29b-5d4ac4321030 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:55.356705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eb1ab-b95b-4c6b-b29b-5d4ac4321030 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:55.356705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7eb1ab-b95b-4c6b-b29b-5d4ac4321030 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:55.358167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 707/1389] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:55.363540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d041be6-68eb-4da6-b835-9b202da9d820 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:55.364029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d041be6-68eb-4da6-b835-9b202da9d820 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:55.364118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d041be6-68eb-4da6-b835-9b202da9d820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:55.433647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-5d041be6-68eb-4da6-b835-9b202da9d820 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:55.434789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5d041be6-68eb-4da6-b835-9b202da9d820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:55.464341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c650f4f-1b44-40d1-b2ca-ff6deefe9739 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:55.464633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c650f4f-1b44-40d1-b2ca-ff6deefe9739 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:55.464916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c650f4f-1b44-40d1-b2ca-ff6deefe9739 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:55.466261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 708/1390] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:50:55.472444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cbf64-96b9-41a0-a160-0e454cedf091 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:55.472730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cbf64-96b9-41a0-a160-0e454cedf091 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:55.473009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02cbf64-96b9-41a0-a160-0e454cedf091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:55.510916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:55.534955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 683/1391] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:55.543727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-e02cbf64-96b9-41a0-a160-0e454cedf091 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:55.545320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e02cbf64-96b9-41a0-a160-0e454cedf091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:55.643773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 709/1392] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:50:55.836224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ac44-5e09-4eb3-a48a-4791ff49a2d4 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:55.836571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ac44-5e09-4eb3-a48a-4791ff49a2d4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:55.836903 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ac44-5e09-4eb3-a48a-4791ff49a2d4 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:55.838940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 684/1393] 10.222.0.59 () {54 vars in 967 bytes} [Wed Aug 24 06:50:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:55.843798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01cbdc-a86a-4db4-820d-b4312bab6dcd None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:55.844088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01cbdc-a86a-4db4-820d-b4312bab6dcd None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:55.844365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c01cbdc-a86a-4db4-820d-b4312bab6dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:55.921417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3c01cbdc-a86a-4db4-820d-b4312bab6dcd None None] MFA Rules not processed for user `a4aaee9d82b74c45a3a7352595614850`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:55.922622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3c01cbdc-a86a-4db4-820d-b4312bab6dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:55.941242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ac44-5e09-4eb3-a48a-4791ff49a2d4 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:55.942789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f0b0ac44-5e09-4eb3-a48a-4791ff49a2d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:55.956295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:55.976009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:56.002032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 710/1394] 10.222.0.59 () {58 vars in 1064 bytes} [Wed Aug 24 06:50:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:56.009761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01cbdc-a86a-4db4-820d-b4312bab6dcd None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:56.017411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c01cbdc-a86a-4db4-820d-b4312bab6dcd None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:56.098037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ac44-5e09-4eb3-a48a-4791ff49a2d4 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:56.099091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c77fe91-8797-47ac-9fb1-ea6bdaa973c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:56.099701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77fe91-8797-47ac-9fb1-ea6bdaa973c6 service glance] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:56.099976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77fe91-8797-47ac-9fb1-ea6bdaa973c6 service glance] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:56.100246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c77fe91-8797-47ac-9fb1-ea6bdaa973c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:56.101835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1c77fe91-8797-47ac-9fb1-ea6bdaa973c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:56.189761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:56.217073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77fe91-8797-47ac-9fb1-ea6bdaa973c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:56.217837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdcd9b-1427-40b9-a123-fdb713241464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:56.218455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcd9b-1427-40b9-a123-fdb713241464 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:56.218572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c77fe91-8797-47ac-9fb1-ea6bdaa973c6 service glance] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:56.218739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcd9b-1427-40b9-a123-fdb713241464 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:56.219047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdcd9b-1427-40b9-a123-fdb713241464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:56.220678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f0cdcd9b-1427-40b9-a123-fdb713241464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:56.234195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:56.238691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 711/1395] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:50:56.312810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdcd9b-1427-40b9-a123-fdb713241464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:56.314425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdcd9b-1427-40b9-a123-fdb713241464 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:56.332640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 685/1396] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:50:57.173287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a469a-c51f-417d-9696-1944a0e1e8bb None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:57.173794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a469a-c51f-417d-9696-1944a0e1e8bb None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:57.174061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a469a-c51f-417d-9696-1944a0e1e8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:57.243895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-559a469a-c51f-417d-9696-1944a0e1e8bb None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:57.245181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-559a469a-c51f-417d-9696-1944a0e1e8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:57.334702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 712/1397] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:50:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:57.383645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1aa9f-dd2a-4b7a-abc7-10bbb1e04987 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:57.384162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1aa9f-dd2a-4b7a-abc7-10bbb1e04987 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:57.384283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab1aa9f-dd2a-4b7a-abc7-10bbb1e04987 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:57.385556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 686/1398] 10.222.0.59 () {54 vars in 943 bytes} [Wed Aug 24 06:50:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:50:57.391930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c27a7-13c6-4a1c-9b59-3c92ec66a507 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:57.392249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c27a7-13c6-4a1c-9b59-3c92ec66a507 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:57.392512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c27a7-13c6-4a1c-9b59-3c92ec66a507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:57.470881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-945c27a7-13c6-4a1c-9b59-3c92ec66a507 None None] MFA Rules not processed for user `c1dfd6a8d9194f7a949a77207931eb15`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:57.472084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-945c27a7-13c6-4a1c-9b59-3c92ec66a507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:57.500941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:57.579815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 713/1399] 10.222.0.59 () {58 vars in 1040 bytes} [Wed Aug 24 06:50:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:57.589870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1aa9f-dd2a-4b7a-abc7-10bbb1e04987 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:57.591494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5ab1aa9f-dd2a-4b7a-abc7-10bbb1e04987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:57.691079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:57.733790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab1aa9f-dd2a-4b7a-abc7-10bbb1e04987 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:57.837560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5025-6a2c-4b9a-9c12-6da9586993f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:57.838148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5025-6a2c-4b9a-9c12-6da9586993f0 service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:57.838433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5025-6a2c-4b9a-9c12-6da9586993f0 service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:57.838708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5025-6a2c-4b9a-9c12-6da9586993f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:57.840379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bc2c5025-6a2c-4b9a-9c12-6da9586993f0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:57.929556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5025-6a2c-4b9a-9c12-6da9586993f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:57.931221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5025-6a2c-4b9a-9c12-6da9586993f0 service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:57.934723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:57.939790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 687/1400] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 06:50:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:50:58.515285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439180f-a072-4691-b887-89221494a33b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:58.515853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439180f-a072-4691-b887-89221494a33b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:58.515853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4439180f-a072-4691-b887-89221494a33b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:58.517192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 714/1401] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:50:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:50:58.522476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a63b1-0fcf-44a8-bc22-cc21fa585c38 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:58.522976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a63b1-0fcf-44a8-bc22-cc21fa585c38 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:58.523069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92a63b1-0fcf-44a8-bc22-cc21fa585c38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:58.600733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f92a63b1-0fcf-44a8-bc22-cc21fa585c38 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:50:58.602627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f92a63b1-0fcf-44a8-bc22-cc21fa585c38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:58.717970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 688/1402] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:50:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:50:59.028428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439180f-a072-4691-b887-89221494a33b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:50:59.028428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4439180f-a072-4691-b887-89221494a33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:59.206433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4439180f-a072-4691-b887-89221494a33b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:50:59.209476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:50:59.332254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b65e8f-0aa3-4886-842b-9ed23836c781 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:50:59.332864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65e8f-0aa3-4886-842b-9ed23836c781 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:50:59.333144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65e8f-0aa3-4886-842b-9ed23836c781 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:50:59.333415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b65e8f-0aa3-4886-842b-9ed23836c781 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:50:59.335047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-49b65e8f-0aa3-4886-842b-9ed23836c781 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:50:59.427673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b65e8f-0aa3-4886-842b-9ed23836c781 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:50:59.429310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b65e8f-0aa3-4886-842b-9ed23836c781 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:50:59.451048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 715/1403] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:50:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:01.604236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ca14-2f7e-4f12-a0a0-997a24f2925b None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:01.604236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ca14-2f7e-4f12-a0a0-997a24f2925b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:01.604236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ca14-2f7e-4f12-a0a0-997a24f2925b None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:01.604236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 689/1404] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:01.609502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c367-9a1b-423c-8e17-5ec3a4e65a98 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:01.609967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c367-9a1b-423c-8e17-5ec3a4e65a98 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:01.610230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0962c367-9a1b-423c-8e17-5ec3a4e65a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:01.620328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:01.691277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0962c367-9a1b-423c-8e17-5ec3a4e65a98 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:01.692380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0962c367-9a1b-423c-8e17-5ec3a4e65a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:01.813811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 716/1405] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:02.112321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ca14-2f7e-4f12-a0a0-997a24f2925b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:02.113881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d2b8ca14-2f7e-4f12-a0a0-997a24f2925b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:02.208632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:02.292561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ca14-2f7e-4f12-a0a0-997a24f2925b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:02.435099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f41083-0a97-486e-8c31-3a24a3307a94 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:02.435777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41083-0a97-486e-8c31-3a24a3307a94 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:02.436059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41083-0a97-486e-8c31-3a24a3307a94 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:02.436339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f41083-0a97-486e-8c31-3a24a3307a94 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:02.439481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b0f41083-0a97-486e-8c31-3a24a3307a94 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:02.484860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:02.541379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41083-0a97-486e-8c31-3a24a3307a94 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:02.543026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f41083-0a97-486e-8c31-3a24a3307a94 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:02.563545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 690/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:04.808232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af3a5-5c5a-4e5a-8241-1be9b1c2ab06 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:04.808802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af3a5-5c5a-4e5a-8241-1be9b1c2ab06 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:04.808802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6af3a5-5c5a-4e5a-8241-1be9b1c2ab06 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:04.810133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 717/1407] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:04.815657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f46a58-e3c8-42f6-aeef-7d4eb7ed4c44 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:04.816103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f46a58-e3c8-42f6-aeef-7d4eb7ed4c44 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:04.816220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f46a58-e3c8-42f6-aeef-7d4eb7ed4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:04.903807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e0f46a58-e3c8-42f6-aeef-7d4eb7ed4c44 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:04.905096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e0f46a58-e3c8-42f6-aeef-7d4eb7ed4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:05.026885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 691/1408] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:51:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:05.319733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af3a5-5c5a-4e5a-8241-1be9b1c2ab06 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:05.321451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fc6af3a5-5c5a-4e5a-8241-1be9b1c2ab06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:05.420001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:05.493653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6af3a5-5c5a-4e5a-8241-1be9b1c2ab06 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:05.620009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2e8b41-9afe-41fa-8d75-f1e37e37d31b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:05.620536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8b41-9afe-41fa-8d75-f1e37e37d31b service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:05.620818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8b41-9afe-41fa-8d75-f1e37e37d31b service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:05.621095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2e8b41-9afe-41fa-8d75-f1e37e37d31b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:05.622731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8e2e8b41-9afe-41fa-8d75-f1e37e37d31b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:05.683964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:05.731260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8b41-9afe-41fa-8d75-f1e37e37d31b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:05.732951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2e8b41-9afe-41fa-8d75-f1e37e37d31b service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:05.755080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 718/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:15.016898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=93 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:15.752184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=24 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:22.140486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb184-2f3b-4d27-a896-4308504a0cd1 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:22.141058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb184-2f3b-4d27-a896-4308504a0cd1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:22.141058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26eb184-2f3b-4d27-a896-4308504a0cd1 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:22.142433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 692/1410] 10.222.0.59 () {54 vars in 918 bytes} [Wed Aug 24 06:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:22.147716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1661c-8a65-4aba-9c17-84b3fc1c30cb None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:22.148115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1661c-8a65-4aba-9c17-84b3fc1c30cb None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:22.148496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e1661c-8a65-4aba-9c17-84b3fc1c30cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:22.228866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-15e1661c-8a65-4aba-9c17-84b3fc1c30cb None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:22.230097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-15e1661c-8a65-4aba-9c17-84b3fc1c30cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:22.335958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 719/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 06:51:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:22.350423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05cf5-96fb-4023-9f5f-3702e5d8c7c9 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:22.350709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05cf5-96fb-4023-9f5f-3702e5d8c7c9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:22.351010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff05cf5-96fb-4023-9f5f-3702e5d8c7c9 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:22.352857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 693/1412] 10.222.0.59 () {54 vars in 918 bytes} [Wed Aug 24 06:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:22.357729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9f6fe-7379-4a33-9e8e-365f1d544686 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:22.358024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9f6fe-7379-4a33-9e8e-365f1d544686 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:22.358300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e9f6fe-7379-4a33-9e8e-365f1d544686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:22.433115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:22.435833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-08e9f6fe-7379-4a33-9e8e-365f1d544686 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:22.437047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-08e9f6fe-7379-4a33-9e8e-365f1d544686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:22.552409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 720/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Wed Aug 24 06:51:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:24.962278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4c8f-bb46-4eef-a19d-72384b1f1d03 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:24.962831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4c8f-bb46-4eef-a19d-72384b1f1d03 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:24.962831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b4c8f-bb46-4eef-a19d-72384b1f1d03 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:24.964155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 694/1414] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:24.969456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b44d-f032-4e28-a6c4-70f9bfccd9f8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:24.969876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b44d-f032-4e28-a6c4-70f9bfccd9f8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:24.970017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447b44d-f032-4e28-a6c4-70f9bfccd9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:25.034589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f447b44d-f032-4e28-a6c4-70f9bfccd9f8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:25.035837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f447b44d-f032-4e28-a6c4-70f9bfccd9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:25.091348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:25.133849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 721/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:25.416631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b4c8f-bb46-4eef-a19d-72384b1f1d03 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:25.418194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-869b4c8f-bb46-4eef-a19d-72384b1f1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:25.560130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b4c8f-bb46-4eef-a19d-72384b1f1d03 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:25.630736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:25.674642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cc9f6-53b2-424f-84a1-ad925df00d40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:25.675278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cc9f6-53b2-424f-84a1-ad925df00d40 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:25.675582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cc9f6-53b2-424f-84a1-ad925df00d40 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:25.675870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cc9f6-53b2-424f-84a1-ad925df00d40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:25.677746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-919cc9f6-53b2-424f-84a1-ad925df00d40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:25.771683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cc9f6-53b2-424f-84a1-ad925df00d40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:25.773319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cc9f6-53b2-424f-84a1-ad925df00d40 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:25.791616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 695/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:26.689028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e79ba-89cc-4306-b328-874d0460ab95 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:26.689548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e79ba-89cc-4306-b328-874d0460ab95 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:26.689548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85e79ba-89cc-4306-b328-874d0460ab95 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:26.691080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 722/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:26.696440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276daacb-b313-45b3-8591-2bce543c28cb None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:26.696923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276daacb-b313-45b3-8591-2bce543c28cb None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:26.697037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276daacb-b313-45b3-8591-2bce543c28cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:26.772753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-276daacb-b313-45b3-8591-2bce543c28cb None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:26.774485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-276daacb-b313-45b3-8591-2bce543c28cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:26.801962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:26.873089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 696/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:51:27.024398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e79ba-89cc-4306-b328-874d0460ab95 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:27.025916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a85e79ba-89cc-4306-b328-874d0460ab95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:27.172474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85e79ba-89cc-4306-b328-874d0460ab95 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:27.216527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:27.292396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da47f34-b1f3-461a-824c-6b462152156a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:27.293002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47f34-b1f3-461a-824c-6b462152156a service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:27.293282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47f34-b1f3-461a-824c-6b462152156a service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:27.293555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da47f34-b1f3-461a-824c-6b462152156a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:27.295194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9da47f34-b1f3-461a-824c-6b462152156a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:27.382090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da47f34-b1f3-461a-824c-6b462152156a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:27.383764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da47f34-b1f3-461a-824c-6b462152156a service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:27.402272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 723/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:28.301327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed643-4816-4aae-ab22-b2c8e180882f None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:28.301912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed643-4816-4aae-ab22-b2c8e180882f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:28.301912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ed643-4816-4aae-ab22-b2c8e180882f None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:28.303294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 697/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:28.309101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3765ec-600a-4c9b-89ee-9706e7cf75d3 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:28.309564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3765ec-600a-4c9b-89ee-9706e7cf75d3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:28.309689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3765ec-600a-4c9b-89ee-9706e7cf75d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:28.364778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:28.386589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2a3765ec-600a-4c9b-89ee-9706e7cf75d3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:28.387890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2a3765ec-600a-4c9b-89ee-9706e7cf75d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:28.483177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 724/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:28.632889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed643-4816-4aae-ab22-b2c8e180882f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:28.634372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-468ed643-4816-4aae-ab22-b2c8e180882f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:28.785297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ed643-4816-4aae-ab22-b2c8e180882f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:28.797745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:28.904114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75477034-0955-4086-9999-a1bd952fbd6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:28.904645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477034-0955-4086-9999-a1bd952fbd6b service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:28.904930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477034-0955-4086-9999-a1bd952fbd6b service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:28.905205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75477034-0955-4086-9999-a1bd952fbd6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:28.906890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-75477034-0955-4086-9999-a1bd952fbd6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:28.996950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477034-0955-4086-9999-a1bd952fbd6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:28.998654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75477034-0955-4086-9999-a1bd952fbd6b service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:29.017392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 698/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:29.869249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83f44-23c9-408e-af7c-b437b2215f71 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:29.869758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83f44-23c9-408e-af7c-b437b2215f71 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:29.869896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc83f44-23c9-408e-af7c-b437b2215f71 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:29.871542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 725/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:29.876760 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b42e1-5704-43af-a7dc-6c7ad3fd9469 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:29.877203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b42e1-5704-43af-a7dc-6c7ad3fd9469 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:29.877333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b42e1-5704-43af-a7dc-6c7ad3fd9469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:29.897563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:29.954809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e59b42e1-5704-43af-a7dc-6c7ad3fd9469 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:29.956029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e59b42e1-5704-43af-a7dc-6c7ad3fd9469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:30.051938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 699/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:51:30.200588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83f44-23c9-408e-af7c-b437b2215f71 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:30.202028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6bc83f44-23c9-408e-af7c-b437b2215f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:30.312464 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:30.348521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc83f44-23c9-408e-af7c-b437b2215f71 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:30.461200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccf24fb-784c-479c-a6d5-abe7e834bb65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:30.461723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf24fb-784c-479c-a6d5-abe7e834bb65 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:30.462004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf24fb-784c-479c-a6d5-abe7e834bb65 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:30.462275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf24fb-784c-479c-a6d5-abe7e834bb65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:30.463945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9ccf24fb-784c-479c-a6d5-abe7e834bb65 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:30.539281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:30.552428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf24fb-784c-479c-a6d5-abe7e834bb65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:30.554936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccf24fb-784c-479c-a6d5-abe7e834bb65 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:30.574332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 726/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:31.458489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d28f-f153-42ce-b36d-e36a83b1eb7b None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:31.459101 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d28f-f153-42ce-b36d-e36a83b1eb7b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:31.459101 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb78d28f-f153-42ce-b36d-e36a83b1eb7b None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:31.461097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 700/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:31.466071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39857c0-eb66-4cff-9f4d-a9d2df92c40e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:31.466491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39857c0-eb66-4cff-9f4d-a9d2df92c40e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:31.466589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39857c0-eb66-4cff-9f4d-a9d2df92c40e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:31.542870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c39857c0-eb66-4cff-9f4d-a9d2df92c40e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:31.544098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c39857c0-eb66-4cff-9f4d-a9d2df92c40e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:31.639165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 727/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:31.793539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78d28f-f153-42ce-b36d-e36a83b1eb7b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:31.795109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bb78d28f-f153-42ce-b36d-e36a83b1eb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:31.878686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:31.940128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb78d28f-f153-42ce-b36d-e36a83b1eb7b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:32.052972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566145be-f305-4fe3-ac76-4e9a00711b92 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:32.053500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566145be-f305-4fe3-ac76-4e9a00711b92 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:32.053784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566145be-f305-4fe3-ac76-4e9a00711b92 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:32.054093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566145be-f305-4fe3-ac76-4e9a00711b92 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:32.056252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-566145be-f305-4fe3-ac76-4e9a00711b92 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:32.103258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:32.144491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566145be-f305-4fe3-ac76-4e9a00711b92 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:32.146159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566145be-f305-4fe3-ac76-4e9a00711b92 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:32.165411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 701/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:33.065212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca04f-8c0f-4e2b-8c85-7f2b9750b5d1 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:33.065774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca04f-8c0f-4e2b-8c85-7f2b9750b5d1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:33.065774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cca04f-8c0f-4e2b-8c85-7f2b9750b5d1 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:33.067175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 728/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:33.073222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7500f0-17fe-479c-bee1-ba12f0a915e8 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:33.073716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7500f0-17fe-479c-bee1-ba12f0a915e8 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:33.073828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7500f0-17fe-479c-bee1-ba12f0a915e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:33.153857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ee7500f0-17fe-479c-bee1-ba12f0a915e8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:33.155257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ee7500f0-17fe-479c-bee1-ba12f0a915e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:33.377035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 702/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:33.531476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cca04f-8c0f-4e2b-8c85-7f2b9750b5d1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:33.533025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b4cca04f-8c0f-4e2b-8c85-7f2b9750b5d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:33.582348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:33.682937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cca04f-8c0f-4e2b-8c85-7f2b9750b5d1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:33.797704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45326b4-78d6-4be4-9430-035bf99e4259 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:33.798314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45326b4-78d6-4be4-9430-035bf99e4259 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:33.798603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45326b4-78d6-4be4-9430-035bf99e4259 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:33.798910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45326b4-78d6-4be4-9430-035bf99e4259 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:33.800520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a45326b4-78d6-4be4-9430-035bf99e4259 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:33.807579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:33.889280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45326b4-78d6-4be4-9430-035bf99e4259 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:33.890952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45326b4-78d6-4be4-9430-035bf99e4259 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:33.909106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 729/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:34.807823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b02-7e07-445f-a4e3-5b943676afd4 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:34.808449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b02-7e07-445f-a4e3-5b943676afd4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:34.808449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8b5b02-7e07-445f-a4e3-5b943676afd4 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:34.809757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 703/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:34.814607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62920281-b5ef-4c1a-aea1-46c09c5f92c7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:34.815085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62920281-b5ef-4c1a-aea1-46c09c5f92c7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:34.815197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62920281-b5ef-4c1a-aea1-46c09c5f92c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:34.894067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-62920281-b5ef-4c1a-aea1-46c09c5f92c7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:34.895338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-62920281-b5ef-4c1a-aea1-46c09c5f92c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:34.967220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:34.996724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 730/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:35.149574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b02-7e07-445f-a4e3-5b943676afd4 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:35.151308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fd8b5b02-7e07-445f-a4e3-5b943676afd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:35.171780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:35.311627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8b5b02-7e07-445f-a4e3-5b943676afd4 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:35.404854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:35.435030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06271aa-6e11-4c34-8d8b-360c27e30113 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:35.435642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06271aa-6e11-4c34-8d8b-360c27e30113 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:35.435920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06271aa-6e11-4c34-8d8b-360c27e30113 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:35.436193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06271aa-6e11-4c34-8d8b-360c27e30113 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:35.437805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a06271aa-6e11-4c34-8d8b-360c27e30113 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:35.528738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06271aa-6e11-4c34-8d8b-360c27e30113 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:35.530377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06271aa-6e11-4c34-8d8b-360c27e30113 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:35.548658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 704/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:36.478488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163ca8-32c1-4b37-9012-51f3c25ce8b3 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:36.479156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163ca8-32c1-4b37-9012-51f3c25ce8b3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:36.479156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da163ca8-32c1-4b37-9012-51f3c25ce8b3 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:36.480450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 731/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:36.487053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd342-e8fc-48d0-887e-04040dbfa33c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:36.487599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd342-e8fc-48d0-887e-04040dbfa33c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:36.488397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bd342-e8fc-48d0-887e-04040dbfa33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:36.576488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-dc8bd342-e8fc-48d0-887e-04040dbfa33c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:36.577747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-dc8bd342-e8fc-48d0-887e-04040dbfa33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:36.624658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:36.688964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 705/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:36.844230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da163ca8-32c1-4b37-9012-51f3c25ce8b3 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:36.845779 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-da163ca8-32c1-4b37-9012-51f3c25ce8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:37.012531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da163ca8-32c1-4b37-9012-51f3c25ce8b3 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:37.073361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:37.140258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592afac8-56b4-4457-bf1c-df94b3df2314 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:37.140871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afac8-56b4-4457-bf1c-df94b3df2314 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:37.141155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afac8-56b4-4457-bf1c-df94b3df2314 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:37.141430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592afac8-56b4-4457-bf1c-df94b3df2314 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:37.143153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-592afac8-56b4-4457-bf1c-df94b3df2314 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:37.254046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592afac8-56b4-4457-bf1c-df94b3df2314 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:37.255800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592afac8-56b4-4457-bf1c-df94b3df2314 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:37.276450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 732/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:38.174013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a58d8c-69c0-45b5-b055-295a96bdc563 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:38.174617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a58d8c-69c0-45b5-b055-295a96bdc563 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:38.174617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a58d8c-69c0-45b5-b055-295a96bdc563 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:38.175991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 706/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:38.180966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b0d4e-8f04-4682-9dda-38e43073386f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:38.181384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b0d4e-8f04-4682-9dda-38e43073386f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:38.181519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b0d4e-8f04-4682-9dda-38e43073386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:38.261054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-b10b0d4e-8f04-4682-9dda-38e43073386f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:38.262513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b10b0d4e-8f04-4682-9dda-38e43073386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:38.264860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:38.363521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 733/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:38.515697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a58d8c-69c0-45b5-b055-295a96bdc563 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:38.517147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-71a58d8c-69c0-45b5-b055-295a96bdc563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:38.673290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a58d8c-69c0-45b5-b055-295a96bdc563 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:38.704065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:38.796549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec1a15-fae0-4b4c-9292-235865708137 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:38.797169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1a15-fae0-4b4c-9292-235865708137 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:38.797452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1a15-fae0-4b4c-9292-235865708137 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:38.797731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec1a15-fae0-4b4c-9292-235865708137 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:38.799437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-64ec1a15-fae0-4b4c-9292-235865708137 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:38.891901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1a15-fae0-4b4c-9292-235865708137 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:38.893499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec1a15-fae0-4b4c-9292-235865708137 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:38.912009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 707/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:40.746111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea34b2-8b24-47d2-9045-8e3394636d2d None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:40.746669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea34b2-8b24-47d2-9045-8e3394636d2d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:40.746669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdea34b2-8b24-47d2-9045-8e3394636d2d None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:40.748034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 734/1441] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:40.753411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a2c4-95aa-4b9c-b534-5c07580d47db None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:40.753841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a2c4-95aa-4b9c-b534-5c07580d47db None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:40.753944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040a2c4-95aa-4b9c-b534-5c07580d47db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:40.795447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:40.821328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d040a2c4-95aa-4b9c-b534-5c07580d47db None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:40.822555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d040a2c4-95aa-4b9c-b534-5c07580d47db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:40.931193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 708/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:41.213437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea34b2-8b24-47d2-9045-8e3394636d2d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:41.215077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cdea34b2-8b24-47d2-9045-8e3394636d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:41.321603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdea34b2-8b24-47d2-9045-8e3394636d2d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:41.358064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:41.401252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc2b688-604d-4543-bc78-f16ffac7f435 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:41.401865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b688-604d-4543-bc78-f16ffac7f435 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:41.402141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b688-604d-4543-bc78-f16ffac7f435 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:41.402453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc2b688-604d-4543-bc78-f16ffac7f435 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:41.404942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dcc2b688-604d-4543-bc78-f16ffac7f435 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:41.519215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b688-604d-4543-bc78-f16ffac7f435 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:41.520595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc2b688-604d-4543-bc78-f16ffac7f435 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:41.540619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 735/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:43.639041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c397-e64f-4d0d-af29-0159936953b0 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:43.639557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c397-e64f-4d0d-af29-0159936953b0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:43.639557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d571c397-e64f-4d0d-af29-0159936953b0 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:43.640887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 709/1444] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:43.649074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815806-7fbb-4222-a6a0-2bd07ba398a4 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:43.649668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815806-7fbb-4222-a6a0-2bd07ba398a4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:43.650177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce815806-7fbb-4222-a6a0-2bd07ba398a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:43.731020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ce815806-7fbb-4222-a6a0-2bd07ba398a4 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:43.732256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ce815806-7fbb-4222-a6a0-2bd07ba398a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:43.746337 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:43.832424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 736/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:44.127517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571c397-e64f-4d0d-af29-0159936953b0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:44.129079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d571c397-e64f-4d0d-af29-0159936953b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:44.239260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d571c397-e64f-4d0d-af29-0159936953b0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:44.252395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:44.313209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639afd49-253b-470d-a97c-bcfd7921d5a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:44.313853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afd49-253b-470d-a97c-bcfd7921d5a9 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:44.314135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afd49-253b-470d-a97c-bcfd7921d5a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:44.314407 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639afd49-253b-470d-a97c-bcfd7921d5a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:44.316052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-639afd49-253b-470d-a97c-bcfd7921d5a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:44.428908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639afd49-253b-470d-a97c-bcfd7921d5a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:44.430279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639afd49-253b-470d-a97c-bcfd7921d5a9 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:44.450278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 710/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:51:46.749476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540736-6f0d-431f-81dc-a52835339bd8 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:46.750053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540736-6f0d-431f-81dc-a52835339bd8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:46.750053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58540736-6f0d-431f-81dc-a52835339bd8 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:46.751509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 737/1447] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:51:46.758237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7b7f-ae36-4c8a-94e7-7cae884b78bd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:46.758914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7b7f-ae36-4c8a-94e7-7cae884b78bd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:46.758914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f7b7f-ae36-4c8a-94e7-7cae884b78bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:46.810732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:46.829876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-903f7b7f-ae36-4c8a-94e7-7cae884b78bd None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:46.831270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-903f7b7f-ae36-4c8a-94e7-7cae884b78bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:46.930993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 711/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:51:47.215627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58540736-6f0d-431f-81dc-a52835339bd8 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:47.217356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-58540736-6f0d-431f-81dc-a52835339bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:47.325414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58540736-6f0d-431f-81dc-a52835339bd8 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:47.367714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:47.404679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784caa2f-fe59-4c7f-8557-151bedade2ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:47.405300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784caa2f-fe59-4c7f-8557-151bedade2ee service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:47.405583 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784caa2f-fe59-4c7f-8557-151bedade2ee service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:47.405864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784caa2f-fe59-4c7f-8557-151bedade2ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:47.407539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-784caa2f-fe59-4c7f-8557-151bedade2ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:47.519768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784caa2f-fe59-4c7f-8557-151bedade2ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:47.521122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784caa2f-fe59-4c7f-8557-151bedade2ee service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:47.656752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 738/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:51:49.728300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1495c-3036-4857-ab89-e3345ebce2b7 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:49.728883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1495c-3036-4857-ab89-e3345ebce2b7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:49.728883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1495c-3036-4857-ab89-e3345ebce2b7 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:49.730239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 712/1450] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:49.736860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880e6b-4674-4193-bfc0-8551ef1aa5c5 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:49.737518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880e6b-4674-4193-bfc0-8551ef1aa5c5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:49.737518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40880e6b-4674-4193-bfc0-8551ef1aa5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:49.823240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-40880e6b-4674-4193-bfc0-8551ef1aa5c5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:49.824481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-40880e6b-4674-4193-bfc0-8551ef1aa5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:49.847187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:49.925702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 739/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:50.215337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1495c-3036-4857-ab89-e3345ebce2b7 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:50.217100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1ec1495c-3036-4857-ab89-e3345ebce2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:50.333506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1495c-3036-4857-ab89-e3345ebce2b7 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:50.355183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:50.411614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa737f3-2761-48ef-98a3-eb4a77efc847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:50.412129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa737f3-2761-48ef-98a3-eb4a77efc847 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:50.412410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa737f3-2761-48ef-98a3-eb4a77efc847 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:50.412683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa737f3-2761-48ef-98a3-eb4a77efc847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:50.414671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-efa737f3-2761-48ef-98a3-eb4a77efc847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:50.533451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa737f3-2761-48ef-98a3-eb4a77efc847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:50.534925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa737f3-2761-48ef-98a3-eb4a77efc847 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:50.554047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 713/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:52.563437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a90a7-2254-4f69-8c69-fb1e46bd0c01 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:52.563995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a90a7-2254-4f69-8c69-fb1e46bd0c01 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:52.564091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145a90a7-2254-4f69-8c69-fb1e46bd0c01 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:52.565493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 740/1453] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:52.571840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54570-d40e-4aca-abe2-16f7aabfdb37 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:52.572277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54570-d40e-4aca-abe2-16f7aabfdb37 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:52.572416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c54570-d40e-4aca-abe2-16f7aabfdb37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:52.647971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:52.650963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e1c54570-d40e-4aca-abe2-16f7aabfdb37 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:52.652248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e1c54570-d40e-4aca-abe2-16f7aabfdb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:52.765712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 714/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:53.050150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a90a7-2254-4f69-8c69-fb1e46bd0c01 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:53.051721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-145a90a7-2254-4f69-8c69-fb1e46bd0c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:53.157876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145a90a7-2254-4f69-8c69-fb1e46bd0c01 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:53.209391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:53.235572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594d01-5106-4d43-b9a8-f5dccb346ec2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:53.236189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594d01-5106-4d43-b9a8-f5dccb346ec2 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:53.236512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594d01-5106-4d43-b9a8-f5dccb346ec2 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:53.236783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594d01-5106-4d43-b9a8-f5dccb346ec2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:53.238441 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e2594d01-5106-4d43-b9a8-f5dccb346ec2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:53.353806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594d01-5106-4d43-b9a8-f5dccb346ec2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:53.355203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594d01-5106-4d43-b9a8-f5dccb346ec2 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:53.374531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 741/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:55.399749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee6185-e47d-4ebd-bf4b-9d9be0ce1cf3 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:55.400399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee6185-e47d-4ebd-bf4b-9d9be0ce1cf3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:55.400399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee6185-e47d-4ebd-bf4b-9d9be0ce1cf3 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:55.401705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 715/1456] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:55.407690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7d20b-c54d-4067-8a4e-0537da9d8760 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:55.408205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7d20b-c54d-4067-8a4e-0537da9d8760 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:55.408303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7d20b-c54d-4067-8a4e-0537da9d8760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:55.476081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6ee7d20b-c54d-4067-8a4e-0537da9d8760 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:55.477333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6ee7d20b-c54d-4067-8a4e-0537da9d8760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:55.507370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:55.580866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 742/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:55.871634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee6185-e47d-4ebd-bf4b-9d9be0ce1cf3 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:55.873296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-34ee6185-e47d-4ebd-bf4b-9d9be0ce1cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:55.985579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee6185-e47d-4ebd-bf4b-9d9be0ce1cf3 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:56.016744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:56.065056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7c6a6-f173-4141-9407-3788ff4c1c16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:56.065679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c6a6-f173-4141-9407-3788ff4c1c16 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:56.065967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c6a6-f173-4141-9407-3788ff4c1c16 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:56.066240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7c6a6-f173-4141-9407-3788ff4c1c16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:56.068577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-10f7c6a6-f173-4141-9407-3788ff4c1c16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:56.195092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7c6a6-f173-4141-9407-3788ff4c1c16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:56.196506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7c6a6-f173-4141-9407-3788ff4c1c16 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:56.216318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 716/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:51:58.256349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902821-15af-419c-ae08-86d9079cdeb6 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:58.256879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902821-15af-419c-ae08-86d9079cdeb6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:58.256879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba902821-15af-419c-ae08-86d9079cdeb6 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:58.258184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 743/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:51:58.264540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fa38-bf28-4022-9ae5-b991a7bae08f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:58.265103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fa38-bf28-4022-9ae5-b991a7bae08f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:58.265350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0882fa38-bf28-4022-9ae5-b991a7bae08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:58.345262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0882fa38-bf28-4022-9ae5-b991a7bae08f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:51:58.346504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0882fa38-bf28-4022-9ae5-b991a7bae08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:58.357063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:58.467671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 717/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:51:58.759819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba902821-15af-419c-ae08-86d9079cdeb6 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:51:58.761400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ba902821-15af-419c-ae08-86d9079cdeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:58.871183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba902821-15af-419c-ae08-86d9079cdeb6 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:51:58.928883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:51:58.948594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7730cc35-4b48-4e65-8869-ed78ea3576f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:51:58.949235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cc35-4b48-4e65-8869-ed78ea3576f7 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:51:58.949524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cc35-4b48-4e65-8869-ed78ea3576f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:51:58.949798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7730cc35-4b48-4e65-8869-ed78ea3576f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:51:58.951501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7730cc35-4b48-4e65-8869-ed78ea3576f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:51:59.066986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730cc35-4b48-4e65-8869-ed78ea3576f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:51:59.068459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7730cc35-4b48-4e65-8869-ed78ea3576f7 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:51:59.087706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 744/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:51:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:01.080523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030813f-2256-4c50-a0d1-7311eaf736e2 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:01.081096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030813f-2256-4c50-a0d1-7311eaf736e2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:01.081096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8030813f-2256-4c50-a0d1-7311eaf736e2 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:01.082431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 718/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:01.088966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc12fe-491d-4d5e-b2bb-d2c26114584f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:01.089597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc12fe-491d-4d5e-b2bb-d2c26114584f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:01.089597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fc12fe-491d-4d5e-b2bb-d2c26114584f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:01.159135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-62fc12fe-491d-4d5e-b2bb-d2c26114584f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:01.160357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-62fc12fe-491d-4d5e-b2bb-d2c26114584f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:01.198916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:01.257354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 745/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:52:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:01.556280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030813f-2256-4c50-a0d1-7311eaf736e2 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:01.557973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8030813f-2256-4c50-a0d1-7311eaf736e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:01.674788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8030813f-2256-4c50-a0d1-7311eaf736e2 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:01.785209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:01.785209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04b3693-88b4-4862-b502-5d6762749e5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:01.785209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3693-88b4-4862-b502-5d6762749e5c service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:01.785209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3693-88b4-4862-b502-5d6762749e5c service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:01.785786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3693-88b4-4862-b502-5d6762749e5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:01.785786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f04b3693-88b4-4862-b502-5d6762749e5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:01.895179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b3693-88b4-4862-b502-5d6762749e5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:01.896640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04b3693-88b4-4862-b502-5d6762749e5c service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:01.917497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 719/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:03.923635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f76b-badc-4df1-b313-0752e9d2adf1 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:03.924300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f76b-badc-4df1-b313-0752e9d2adf1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:03.924300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be99f76b-badc-4df1-b313-0752e9d2adf1 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:03.925597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 746/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:03.932106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869514af-a80e-4583-8010-d496438f5076 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:03.932626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869514af-a80e-4583-8010-d496438f5076 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:03.932742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869514af-a80e-4583-8010-d496438f5076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:04.005849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-869514af-a80e-4583-8010-d496438f5076 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:04.007061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-869514af-a80e-4583-8010-d496438f5076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:04.028086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:04.116774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 720/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:04.398178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f76b-badc-4df1-b313-0752e9d2adf1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:04.399773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-be99f76b-badc-4df1-b313-0752e9d2adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:04.507955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be99f76b-badc-4df1-b313-0752e9d2adf1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:04.576807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:04.584525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d872aa5-c023-4e61-93b6-c69030416369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:04.585142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d872aa5-c023-4e61-93b6-c69030416369 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:04.585424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d872aa5-c023-4e61-93b6-c69030416369 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:04.585700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d872aa5-c023-4e61-93b6-c69030416369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:04.587382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0d872aa5-c023-4e61-93b6-c69030416369 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:04.707479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d872aa5-c023-4e61-93b6-c69030416369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:04.709351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d872aa5-c023-4e61-93b6-c69030416369 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:04.729402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 747/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:06.710586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff47a42-2061-409f-a67f-04d43af51cee None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:06.711285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff47a42-2061-409f-a67f-04d43af51cee None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:06.711285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff47a42-2061-409f-a67f-04d43af51cee None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:06.712788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 721/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:06.718895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efcd6-d81a-4772-b613-d2ebf764c8a6 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:06.719502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efcd6-d81a-4772-b613-d2ebf764c8a6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:06.719502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545efcd6-d81a-4772-b613-d2ebf764c8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:06.789352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-545efcd6-d81a-4772-b613-d2ebf764c8a6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:06.790598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-545efcd6-d81a-4772-b613-d2ebf764c8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:06.840556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:06.893702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 748/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:07.177430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff47a42-2061-409f-a67f-04d43af51cee None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:07.179111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-eff47a42-2061-409f-a67f-04d43af51cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:07.285158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff47a42-2061-409f-a67f-04d43af51cee None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:07.335902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:07.362709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1e4189-a4ba-4470-9d0b-2db0c403e6ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:07.363356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4189-a4ba-4470-9d0b-2db0c403e6ea service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:07.363636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4189-a4ba-4470-9d0b-2db0c403e6ea service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:07.363968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1e4189-a4ba-4470-9d0b-2db0c403e6ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:07.365602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fc1e4189-a4ba-4470-9d0b-2db0c403e6ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:07.475664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e4189-a4ba-4470-9d0b-2db0c403e6ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:07.476995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1e4189-a4ba-4470-9d0b-2db0c403e6ea service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:07.497210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 722/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:16.891167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=22 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:17.494867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=66 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:27.371278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23e1c-6de0-4b30-8e7f-a6c1f349e09a None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:27.371854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23e1c-6de0-4b30-8e7f-a6c1f349e09a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:27.371854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b23e1c-6de0-4b30-8e7f-a6c1f349e09a None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:27.373219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 749/1471] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:27.378731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bad49-1e61-4c2a-b398-fd16ef8d94b9 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:27.379210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bad49-1e61-4c2a-b398-fd16ef8d94b9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:27.379325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8bad49-1e61-4c2a-b398-fd16ef8d94b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:27.450732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-5a8bad49-1e61-4c2a-b398-fd16ef8d94b9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:27.452011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5a8bad49-1e61-4c2a-b398-fd16ef8d94b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:27.547441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 723/1472] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:52:27.849603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b637f1-fb87-49f2-80fc-dfdba7cf383e None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:27.849896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b637f1-fb87-49f2-80fc-dfdba7cf383e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:27.850177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b637f1-fb87-49f2-80fc-dfdba7cf383e None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:27.851605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 750/1473] 10.222.0.59 () {54 vars in 967 bytes} [Wed Aug 24 06:52:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:27.856815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4a4c-0ed3-489f-b683-c16b71b4ad57 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:27.857107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4a4c-0ed3-489f-b683-c16b71b4ad57 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:27.857385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877d4a4c-0ed3-489f-b683-c16b71b4ad57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:27.952288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-877d4a4c-0ed3-489f-b683-c16b71b4ad57 None None] MFA Rules not processed for user `a4aaee9d82b74c45a3a7352595614850`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:27.953608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-877d4a4c-0ed3-489f-b683-c16b71b4ad57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:27.975919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:28.033142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 724/1474] 10.222.0.59 () {58 vars in 1064 bytes} [Wed Aug 24 06:52:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:28.041287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b637f1-fb87-49f2-80fc-dfdba7cf383e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:28.042847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-57b637f1-fb87-49f2-80fc-dfdba7cf383e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:28.146917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b637f1-fb87-49f2-80fc-dfdba7cf383e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:28.222096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13932d39-bcd4-4990-8937-4eaa49816c81 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:28.222701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932d39-bcd4-4990-8937-4eaa49816c81 service glance] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:28.223015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932d39-bcd4-4990-8937-4eaa49816c81 service glance] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:28.223295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13932d39-bcd4-4990-8937-4eaa49816c81 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:28.224905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-13932d39-bcd4-4990-8937-4eaa49816c81 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:28.282900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:28.342392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13932d39-bcd4-4990-8937-4eaa49816c81 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:28.343889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13932d39-bcd4-4990-8937-4eaa49816c81 service glance] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:28.366392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 751/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:30.411067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074d25-079a-461d-873d-514a1f300660 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:30.411641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074d25-079a-461d-873d-514a1f300660 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:30.411786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76074d25-079a-461d-873d-514a1f300660 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:30.413501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 725/1476] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:52:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:30.419259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090c66-9723-4e71-ab99-182be47edf72 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:30.419804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090c66-9723-4e71-ab99-182be47edf72 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:30.419804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a090c66-9723-4e71-ab99-182be47edf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:30.496734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2a090c66-9723-4e71-ab99-182be47edf72 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:30.497991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2a090c66-9723-4e71-ab99-182be47edf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:30.607636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 752/1477] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:30.879663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074d25-079a-461d-873d-514a1f300660 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:30.881146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-76074d25-079a-461d-873d-514a1f300660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:31.022208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76074d25-079a-461d-873d-514a1f300660 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:31.072006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:31.118987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de89dc6-2157-41df-acdb-b6540cd06557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:31.119598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de89dc6-2157-41df-acdb-b6540cd06557 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:31.119879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de89dc6-2157-41df-acdb-b6540cd06557 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:31.120151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de89dc6-2157-41df-acdb-b6540cd06557 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:31.120839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de89dc6-2157-41df-acdb-b6540cd06557 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:31.122651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-4de89dc6-2157-41df-acdb-b6540cd06557 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:52:31.122651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:52:31.122651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:52:31.123837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de89dc6-2157-41df-acdb-b6540cd06557 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:31.142901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 726/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Wed Aug 24 06:52:30 2022] GET /identity/v3/projects => generated 2553 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:52:33.095683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d68ce-4256-421a-aab9-368ffc45c7cc None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:33.101977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d68ce-4256-421a-aab9-368ffc45c7cc None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:33.101977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d68ce-4256-421a-aab9-368ffc45c7cc None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:33.101977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 753/1479] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:52:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:33.104082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405ce41-505d-4ff7-a332-1dd8a0e7d85e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:33.104565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405ce41-505d-4ff7-a332-1dd8a0e7d85e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:33.104665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5405ce41-505d-4ff7-a332-1dd8a0e7d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:33.179387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-5405ce41-505d-4ff7-a332-1dd8a0e7d85e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:33.180670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5405ce41-505d-4ff7-a332-1dd8a0e7d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:33.280116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 727/1480] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:52:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:33.574784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d68ce-4256-421a-aab9-368ffc45c7cc None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:33.576354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4b5d68ce-4256-421a-aab9-368ffc45c7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:33.585972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:33.728926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d68ce-4256-421a-aab9-368ffc45c7cc None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:33.808841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:33.840951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590fafc0-9655-46a8-a3c4-48586b01f439 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:33.841476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fafc0-9655-46a8-a3c4-48586b01f439 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:33.841753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fafc0-9655-46a8-a3c4-48586b01f439 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:33.842022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590fafc0-9655-46a8-a3c4-48586b01f439 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:33.843640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-590fafc0-9655-46a8-a3c4-48586b01f439 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:33.933360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fafc0-9655-46a8-a3c4-48586b01f439 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:33.934927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590fafc0-9655-46a8-a3c4-48586b01f439 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:33.952628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 754/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:36.086680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423f8d-bba3-4dfc-8de1-715b48c2792e None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:36.087272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423f8d-bba3-4dfc-8de1-715b48c2792e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:36.087272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb423f8d-bba3-4dfc-8de1-715b48c2792e None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:36.088662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 728/1482] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:36.094607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b4b8f-a17e-4d15-ae4a-69c8fabe4f44 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:36.095138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b4b8f-a17e-4d15-ae4a-69c8fabe4f44 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:36.095278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64b4b8f-a17e-4d15-ae4a-69c8fabe4f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:36.164355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a64b4b8f-a17e-4d15-ae4a-69c8fabe4f44 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:36.165590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a64b4b8f-a17e-4d15-ae4a-69c8fabe4f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:36.216434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:36.272137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 755/1483] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:36.561737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423f8d-bba3-4dfc-8de1-715b48c2792e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:36.563393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bb423f8d-bba3-4dfc-8de1-715b48c2792e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:36.589008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:36.676757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb423f8d-bba3-4dfc-8de1-715b48c2792e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:36.751497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dc08e0-c2e4-4a4b-999a-3190e41c8f44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:36.752108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc08e0-c2e4-4a4b-999a-3190e41c8f44 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:36.753656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc08e0-c2e4-4a4b-999a-3190e41c8f44 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:36.753656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dc08e0-c2e4-4a4b-999a-3190e41c8f44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:36.754887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c9dc08e0-c2e4-4a4b-999a-3190e41c8f44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:36.828997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:36.863166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc08e0-c2e4-4a4b-999a-3190e41c8f44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:36.864596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dc08e0-c2e4-4a4b-999a-3190e41c8f44 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:36.882563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 729/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:38.824143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c624c-10f2-4785-a1c4-76f78ad104fe None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:38.824707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c624c-10f2-4785-a1c4-76f78ad104fe None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:38.824707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3c624c-10f2-4785-a1c4-76f78ad104fe None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:38.826024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 756/1485] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:38.831663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308bb35-b934-41bd-a77a-0ac030d85380 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:38.832118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308bb35-b934-41bd-a77a-0ac030d85380 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:38.832214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9308bb35-b934-41bd-a77a-0ac030d85380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:38.898655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-9308bb35-b934-41bd-a77a-0ac030d85380 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:38.900009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9308bb35-b934-41bd-a77a-0ac030d85380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:38.997348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 730/1486] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:52:39.283830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c624c-10f2-4785-a1c4-76f78ad104fe None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:39.285359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9b3c624c-10f2-4785-a1c4-76f78ad104fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:39.404397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3c624c-10f2-4785-a1c4-76f78ad104fe None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:39.483254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:39.485097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18609e78-e1cc-4e34-aff7-d4dcf921b418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:39.485878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609e78-e1cc-4e34-aff7-d4dcf921b418 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:39.486282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609e78-e1cc-4e34-aff7-d4dcf921b418 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:39.487347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18609e78-e1cc-4e34-aff7-d4dcf921b418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:39.489129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-18609e78-e1cc-4e34-aff7-d4dcf921b418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:39.600245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18609e78-e1cc-4e34-aff7-d4dcf921b418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:39.601689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18609e78-e1cc-4e34-aff7-d4dcf921b418 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:39.621123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 757/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:41.734543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc16fc-5c04-454e-aef6-30915d47ca51 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:41.735072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc16fc-5c04-454e-aef6-30915d47ca51 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:41.735178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fc16fc-5c04-454e-aef6-30915d47ca51 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:41.737132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 731/1488] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:41.742585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbe473-67ab-436f-9968-42e5b8cf0064 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:41.743088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbe473-67ab-436f-9968-42e5b8cf0064 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:41.743190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdbe473-67ab-436f-9968-42e5b8cf0064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:41.809828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ffdbe473-67ab-436f-9968-42e5b8cf0064 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:41.811111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ffdbe473-67ab-436f-9968-42e5b8cf0064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:41.866157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:41.911819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 758/1489] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:52:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:42.203602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc16fc-5c04-454e-aef6-30915d47ca51 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:42.205656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-35fc16fc-5c04-454e-aef6-30915d47ca51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:42.242851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:42.311581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fc16fc-5c04-454e-aef6-30915d47ca51 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:42.385473 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9b7f13-2cd4-4f28-ba38-b45cce7390f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:42.386089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b7f13-2cd4-4f28-ba38-b45cce7390f3 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:42.386374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b7f13-2cd4-4f28-ba38-b45cce7390f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:42.386647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9b7f13-2cd4-4f28-ba38-b45cce7390f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:42.388348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-da9b7f13-2cd4-4f28-ba38-b45cce7390f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:42.473924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:42.504855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b7f13-2cd4-4f28-ba38-b45cce7390f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:42.506309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9b7f13-2cd4-4f28-ba38-b45cce7390f3 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:42.524512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 732/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:44.946637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006384-bd6f-478c-be0c-6bf7a07996c1 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:44.947237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006384-bd6f-478c-be0c-6bf7a07996c1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:44.947351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a006384-bd6f-478c-be0c-6bf7a07996c1 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:44.948636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 759/1491] 10.222.0.59 () {54 vars in 927 bytes} [Wed Aug 24 06:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:52:44.954654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacc1d-9d13-474f-a430-ae27b56af58f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:44.954654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacc1d-9d13-474f-a430-ae27b56af58f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:44.955750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aacc1d-9d13-474f-a430-ae27b56af58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:45.032028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-59aacc1d-9d13-474f-a430-ae27b56af58f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:52:45.033159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-59aacc1d-9d13-474f-a430-ae27b56af58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:45.137097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 733/1492] 10.222.0.59 () {58 vars in 1024 bytes} [Wed Aug 24 06:52:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:52:45.428423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006384-bd6f-478c-be0c-6bf7a07996c1 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:52:45.430037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8a006384-bd6f-478c-be0c-6bf7a07996c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:45.537259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a006384-bd6f-478c-be0c-6bf7a07996c1 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:52:45.612279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd4ee1-e4a2-44e0-831d-2c21532f9acc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:52:45.612884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4ee1-e4a2-44e0-831d-2c21532f9acc service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:52:45.613160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4ee1-e4a2-44e0-831d-2c21532f9acc service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:52:45.613430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd4ee1-e4a2-44e0-831d-2c21532f9acc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:52:45.615891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9fcd4ee1-e4a2-44e0-831d-2c21532f9acc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:52:45.624961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:45.736329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd4ee1-e4a2-44e0-831d-2c21532f9acc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:52:45.737832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcd4ee1-e4a2-44e0-831d-2c21532f9acc service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:52:45.756782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 760/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:52:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:52:55.135113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=82 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:52:55.754305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=50 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:08.395664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:08.396322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:08.396322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:08.471731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:54:08.472929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:08.566338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 734/1494] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:54:08.575345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9560d-93e3-46f6-89b2-701517408416 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:08.575857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9560d-93e3-46f6-89b2-701517408416 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:08.575964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee9560d-93e3-46f6-89b2-701517408416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:08.651486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9ee9560d-93e3-46f6-89b2-701517408416 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:54:08.653040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9ee9560d-93e3-46f6-89b2-701517408416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:08.751690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 761/1495] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:54:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:54:08.756465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:08.757732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:08.769887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf6ed7-0d63-41ae-9101-4fa98f74c80e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:08.830308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:08.863390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:08.864005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:08.864288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:08.864569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:08.865211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:54:08.865515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:08.866551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:08.866551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:54:08.866551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:54:08.867488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:08.879200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 735/1496] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:54:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:54:08.888141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9560d-93e3-46f6-89b2-701517408416 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:08.897329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee9560d-93e3-46f6-89b2-701517408416 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:08.958239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:08.991672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:08.992274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:08.992555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:08.992829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:08.993471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:08.995268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING py.warnings [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:08.995268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: warnings.warn(msg) Aug 24 06:54:08.995268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: Aug 24 06:54:08.996489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:09.114660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 762/1497] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:54:08 2022] POST /identity/v3/projects => generated 377 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:54:09.119307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:09.120964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:09.157549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80b617f-34c8-4a96-a22f-0ea8f3e997ad admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:09.250707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:09.251269 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:09.251548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:09.251819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:09.252447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:09.253447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:09.253447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:54:09.253447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:54:09.254662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:09.387578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 736/1498] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:54:09 2022] POST /identity/v3/users => generated 289 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:54:09.392107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:09.393713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:09.455896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19426020-b30c-4abd-96d0-a146fd5dd633 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:09.538249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:09.548462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:09.549075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:09.549359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:09.549634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:09.550280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:09.551317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING py.warnings [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:09.551317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: warnings.warn(msg) Aug 24 06:54:09.551317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: Aug 24 06:54:09.552202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:09.564936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 763/1499] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:54:09.569026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:09.570668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:09.583128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b0906-93a3-4e79-b623-66e45987471e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:09.608345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:09.679603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ded1a6-e831-4b15-8333-01b8d8c7b0d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:09.680217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded1a6-e831-4b15-8333-01b8d8c7b0d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:09.680503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded1a6-e831-4b15-8333-01b8d8c7b0d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:09.680897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ded1a6-e831-4b15-8333-01b8d8c7b0d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:09.681522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded1a6-e831-4b15-8333-01b8d8c7b0d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:09.683209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-67ded1a6-e831-4b15-8333-01b8d8c7b0d2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:09.683209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:54:09.683209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:54:09.684099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ded1a6-e831-4b15-8333-01b8d8c7b0d2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:09.697223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 737/1500] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:54:09 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:54:09.701118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:09.702693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:09.736229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c48031-81de-41c0-99cd-9c03cd5e8bd2 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:09.829286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0326f88a-627c-4356-98cc-f36ab484e5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:09.829859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326f88a-627c-4356-98cc-f36ab484e5d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:09.830143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326f88a-627c-4356-98cc-f36ab484e5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:09.830421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0326f88a-627c-4356-98cc-f36ab484e5d1 admin admin] PATH_INFO: `/v3/projects/2c111223552d424aaf7741d2292f8c42/users/9f05886f1f7343328c319546cab83a98/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:09.852169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326f88a-627c-4356-98cc-f36ab484e5d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c111223552d424aaf7741d2292f8c42, user_id=9f05886f1f7343328c319546cab83a98, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:09.853212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING py.warnings [None req-0326f88a-627c-4356-98cc-f36ab484e5d1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:09.853212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: warnings.warn(msg) Aug 24 06:54:09.853212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: Aug 24 06:54:09.855728 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0326f88a-627c-4356-98cc-f36ab484e5d1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:09.988280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 764/1501] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:54:09 2022] PUT /identity/v3/projects/2c111223552d424aaf7741d2292f8c42/users/9f05886f1f7343328c319546cab83a98/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:54:10.000786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114b50-8f0f-4f44-be02-d8ac0763ae03 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:10.001095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114b50-8f0f-4f44-be02-d8ac0763ae03 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:10.001379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26114b50-8f0f-4f44-be02-d8ac0763ae03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:10.057333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-26114b50-8f0f-4f44-be02-d8ac0763ae03 None None] MFA Rules not processed for user `9f05886f1f7343328c319546cab83a98`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:54:10.059090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-26114b50-8f0f-4f44-be02-d8ac0763ae03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:10.134436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 738/1502] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:54:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:54:10.148794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9756d-50f3-478c-ba08-aa6f24d799be None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:10.149082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9756d-50f3-478c-ba08-aa6f24d799be None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:10.149367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9756d-50f3-478c-ba08-aa6f24d799be None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:10.150696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 765/1503] 10.222.0.59 () {54 vars in 964 bytes} [Wed Aug 24 06:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:54:10.155912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b5a5-b45a-4f12-ad9c-a1b641066a87 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:10.156212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b5a5-b45a-4f12-ad9c-a1b641066a87 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:10.156497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1b5a5-b45a-4f12-ad9c-a1b641066a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:10.188736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:10.234047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-24f1b5a5-b45a-4f12-ad9c-a1b641066a87 None None] MFA Rules not processed for user `cc7c77697ae44017bfb40f9c77ffea1c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:54:10.235314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-24f1b5a5-b45a-4f12-ad9c-a1b641066a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:10.310117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 739/1504] 10.222.0.59 () {58 vars in 1061 bytes} [Wed Aug 24 06:54:10 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:54:10.317835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9756d-50f3-478c-ba08-aa6f24d799be None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:10.319394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d1e9756d-50f3-478c-ba08-aa6f24d799be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:10.368119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:10.423890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9756d-50f3-478c-ba08-aa6f24d799be None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:10.501659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:10.502268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:10.502550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:10.502852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:10.504494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:10.603791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:10.605261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:10.608794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:10.622826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 766/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:54:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:54:10.669144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040349-9315-426b-94c4-779357d1a393 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:10.670544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040349-9315-426b-94c4-779357d1a393 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:10.670544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53040349-9315-426b-94c4-779357d1a393 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:10.671255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 740/1506] 10.222.0.59 () {52 vars in 830 bytes} [Wed Aug 24 06:54:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:54:10.674968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:10.676181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:10.775542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39ba043-2724-4e03-9e03-25b152e7f7dc service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:10.868639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:10.869274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:10.869552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:10.869826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] PATH_INFO: `/v3/users/9f05886f1f7343328c319546cab83a98` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:10.882446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f05886f1f7343328c319546cab83a98)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:10.883502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING py.warnings [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:10.883502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: warnings.warn(msg) Aug 24 06:54:10.883502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: Aug 24 06:54:10.884720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:10.894826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:11.125460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f05886f1f7343328c319546cab83a98'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:11.125879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f05886f1f7343328c319546cab83a98'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:11.210192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f05886f1f7343328c319546cab83a98'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:11.225947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f05886f1f7343328c319546cab83a98'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:11.250196 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f05886f1f7343328c319546cab83a98'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:11.256199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 767/1507] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:54:10 2022] DELETE /identity/v3/users/9f05886f1f7343328c319546cab83a98 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:54:11.260708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:11.261001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:11.261279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:11.316748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:54:11.317967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:11.391145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:11.404007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 741/1508] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:54:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:54:11.413905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:11.415177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:11.518570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32adb593-fcfb-4fa7-99a4-94b70d9c54cd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:11.572454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:11.592539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8272f1-487e-46b4-83f0-8e294889a540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:11.593154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8272f1-487e-46b4-83f0-8e294889a540 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:11.593437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8272f1-487e-46b4-83f0-8e294889a540 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:11.593716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8272f1-487e-46b4-83f0-8e294889a540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:11.595547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bf8272f1-487e-46b4-83f0-8e294889a540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:11.708204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8272f1-487e-46b4-83f0-8e294889a540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:11.709710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8272f1-487e-46b4-83f0-8e294889a540 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:11.728202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 768/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:54:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:54:12.189887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:54:12.191163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:54:12.202963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3da15bc-864e-4022-8652-6ef4cfd2b033 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:54:12.304946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:54:12.305587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:54:12.305875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:54:12.306155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] PATH_INFO: `/v3/projects/2c111223552d424aaf7741d2292f8c42` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:54:12.316051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c111223552d424aaf7741d2292f8c42)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:54:12.317100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:54:12.317100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:54:12.317100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:54:12.318323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:54:12.435749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c111223552d424aaf7741d2292f8c42', 'request_id': 'req-2c98424f-8387-4b9c-85a0-e6b7212839ec'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:12.448599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c111223552d424aaf7741d2292f8c42', 'request_id': 'req-2c98424f-8387-4b9c-85a0-e6b7212839ec'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:12.454693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c111223552d424aaf7741d2292f8c42', 'request_id': 'req-2c98424f-8387-4b9c-85a0-e6b7212839ec'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:12.564778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] The token cache is being invalidate because project 2c111223552d424aaf7741d2292f8c42 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:54:12.565077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:12.565543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c98424f-8387-4b9c-85a0-e6b7212839ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:54:12.567051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 742/1510] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:54:12 2022] DELETE /identity/v3/projects/2c111223552d424aaf7741d2292f8c42 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:54:21.726083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=62 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:54:22.562552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:50.031653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8670b-4e63-4a5e-b45f-142f796b4d65 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:50.032224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8670b-4e63-4a5e-b45f-142f796b4d65 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:50.032224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f8670b-4e63-4a5e-b45f-142f796b4d65 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:50.033486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 769/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:55:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:55:50.038509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da3b4-118b-4f5d-9cb4-b921ef8fa151 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:50.039044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da3b4-118b-4f5d-9cb4-b921ef8fa151 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:50.039154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676da3b4-118b-4f5d-9cb4-b921ef8fa151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:50.129538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-676da3b4-118b-4f5d-9cb4-b921ef8fa151 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:55:50.131133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-676da3b4-118b-4f5d-9cb4-b921ef8fa151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:55:50.254041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 743/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:55:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:55:50.409081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8670b-4e63-4a5e-b45f-142f796b4d65 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:55:50.411900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-20f8670b-4e63-4a5e-b45f-142f796b4d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:55:50.543761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f8670b-4e63-4a5e-b45f-142f796b4d65 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:55:50.549614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2cd25-4670-476a-b30f-1565322c31d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:55:50.550223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2cd25-4670-476a-b30f-1565322c31d9 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:50.550504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2cd25-4670-476a-b30f-1565322c31d9 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:50.550804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2cd25-4670-476a-b30f-1565322c31d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:50.559033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2cd25-4670-476a-b30f-1565322c31d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:55:50.560616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2cd25-4670-476a-b30f-1565322c31d9 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:55:50.570794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 770/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:55:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:55:51.416258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae673e3-fd46-4fb5-a962-ae2935a1ce5b None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:51.416817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae673e3-fd46-4fb5-a962-ae2935a1ce5b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:51.416817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae673e3-fd46-4fb5-a962-ae2935a1ce5b None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:51.418203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 744/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:55:51.423372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55f8a-f02a-4764-a8f9-8e6eec531dc7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:51.424237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55f8a-f02a-4764-a8f9-8e6eec531dc7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:51.424409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c55f8a-f02a-4764-a8f9-8e6eec531dc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:51.447438 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-00c55f8a-f02a-4764-a8f9-8e6eec531dc7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:55:51.448687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-00c55f8a-f02a-4764-a8f9-8e6eec531dc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:55:51.456751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 771/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:55:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:55:51.608701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae673e3-fd46-4fb5-a962-ae2935a1ce5b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:55:51.623627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae673e3-fd46-4fb5-a962-ae2935a1ce5b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:55:51.629259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3225b25-4ec5-4086-9bcb-6d124ce0f1ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:55:51.629866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225b25-4ec5-4086-9bcb-6d124ce0f1ca service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:51.630143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225b25-4ec5-4086-9bcb-6d124ce0f1ca service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:51.630413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3225b25-4ec5-4086-9bcb-6d124ce0f1ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:51.639165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225b25-4ec5-4086-9bcb-6d124ce0f1ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:55:51.640767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3225b25-4ec5-4086-9bcb-6d124ce0f1ca service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:55:51.650978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 745/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:55:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:55:52.134139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bfcde-1624-4816-8721-a180162d2e4b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:52.134428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bfcde-1624-4816-8721-a180162d2e4b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:52.134709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5bfcde-1624-4816-8721-a180162d2e4b None None] PATH_INFO: `/v3` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:52.136041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 772/1517] 10.222.0.27 () {54 vars in 925 bytes} [Wed Aug 24 06:55:52 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:55:52.146040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f3050-5b3f-4d23-bc3e-a9c332093839 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:52.146331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f3050-5b3f-4d23-bc3e-a9c332093839 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:52.146617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f3050-5b3f-4d23-bc3e-a9c332093839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:52.206371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c76f3050-5b3f-4d23-bc3e-a9c332093839 None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:55:52.207676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c76f3050-5b3f-4d23-bc3e-a9c332093839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:55:52.225476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:55:52.282084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 746/1518] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 06:55:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:55:56.454113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65dd3-8a9e-4369-b081-697092512ea5 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:56.454626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65dd3-8a9e-4369-b081-697092512ea5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:56.454626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd65dd3-8a9e-4369-b081-697092512ea5 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:56.456807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 773/1519] 10.222.0.59 () {54 vars in 961 bytes} [Wed Aug 24 06:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:55:56.461728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abdfe9-d99d-4aff-94bf-0f9ed3d5cc4a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:56.462179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abdfe9-d99d-4aff-94bf-0f9ed3d5cc4a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:56.462291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5abdfe9-d99d-4aff-94bf-0f9ed3d5cc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:56.481882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c5abdfe9-d99d-4aff-94bf-0f9ed3d5cc4a None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:55:56.483238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c5abdfe9-d99d-4aff-94bf-0f9ed3d5cc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:55:56.492671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 747/1520] 10.222.0.59 () {58 vars in 1058 bytes} [Wed Aug 24 06:55:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:55:56.500499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65dd3-8a9e-4369-b081-697092512ea5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:55:56.514659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd65dd3-8a9e-4369-b081-697092512ea5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:55:56.519938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee45ea6-70cf-43fe-b85f-64bb4139346e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:55:56.520542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45ea6-70cf-43fe-b85f-64bb4139346e service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:55:56.520820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45ea6-70cf-43fe-b85f-64bb4139346e service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:55:56.521095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee45ea6-70cf-43fe-b85f-64bb4139346e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:55:56.529880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee45ea6-70cf-43fe-b85f-64bb4139346e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:55:56.531753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee45ea6-70cf-43fe-b85f-64bb4139346e service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:55:56.541934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 774/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:55:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:56:02.914816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab5012-7d6f-4cf2-b124-14c021563304 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:02.915383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab5012-7d6f-4cf2-b124-14c021563304 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:02.915383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ab5012-7d6f-4cf2-b124-14c021563304 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:02.916731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 748/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:56:02.921654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bef6-f7f8-467c-956f-1e3cee4ddd37 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:02.922067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bef6-f7f8-467c-956f-1e3cee4ddd37 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:02.922203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f8bef6-f7f8-467c-956f-1e3cee4ddd37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:02.942247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-17f8bef6-f7f8-467c-956f-1e3cee4ddd37 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:56:02.943504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-17f8bef6-f7f8-467c-956f-1e3cee4ddd37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:02.951447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 775/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:56:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:56:03.107103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab5012-7d6f-4cf2-b124-14c021563304 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:56:03.122637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ab5012-7d6f-4cf2-b124-14c021563304 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:56:03.129646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd527a4-e4fd-40e4-8f37-beec710f9b1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:56:03.130335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd527a4-e4fd-40e4-8f37-beec710f9b1a service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:03.131729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd527a4-e4fd-40e4-8f37-beec710f9b1a service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:03.131729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd527a4-e4fd-40e4-8f37-beec710f9b1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:03.140530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd527a4-e4fd-40e4-8f37-beec710f9b1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:56:03.142129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd527a4-e4fd-40e4-8f37-beec710f9b1a service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:56:03.155642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 749/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:56:03.988887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd891d3-5c7e-4d49-b166-469544d48358 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:03.989431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd891d3-5c7e-4d49-b166-469544d48358 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:03.989431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd891d3-5c7e-4d49-b166-469544d48358 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:03.990874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 776/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 24 06:56:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:56:03.996182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3da12-a6fd-4669-9d85-fea019dc71f2 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:03.996640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3da12-a6fd-4669-9d85-fea019dc71f2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:03.996763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3da12-a6fd-4669-9d85-fea019dc71f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:04.016332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-bce3da12-a6fd-4669-9d85-fea019dc71f2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:56:04.017518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bce3da12-a6fd-4669-9d85-fea019dc71f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:04.025481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 750/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 24 06:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:56:04.181360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd891d3-5c7e-4d49-b166-469544d48358 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:56:04.196654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd891d3-5c7e-4d49-b166-469544d48358 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:56:04.202177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e2bfb0-1890-48d2-824b-6bc653321588 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:56:04.202791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bfb0-1890-48d2-824b-6bc653321588 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:04.203080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bfb0-1890-48d2-824b-6bc653321588 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:04.203354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e2bfb0-1890-48d2-824b-6bc653321588 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:04.211610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2bfb0-1890-48d2-824b-6bc653321588 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:56:04.213202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e2bfb0-1890-48d2-824b-6bc653321588 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:56:04.222794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 777/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:56:08.315477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40fa5b-d03d-4b6a-8747-4f5a9bf0870a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:08.316258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40fa5b-d03d-4b6a-8747-4f5a9bf0870a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:08.316258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f40fa5b-d03d-4b6a-8747-4f5a9bf0870a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:08.317411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 751/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:56:08.323326 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862d39-be8c-421a-8cdb-7a76902258df None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:08.323873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862d39-be8c-421a-8cdb-7a76902258df None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:08.323873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6862d39-be8c-421a-8cdb-7a76902258df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:08.344484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c6862d39-be8c-421a-8cdb-7a76902258df None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:56:08.345801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c6862d39-be8c-421a-8cdb-7a76902258df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:08.354010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 778/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:56:08.647716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40fa5b-d03d-4b6a-8747-4f5a9bf0870a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:56:08.649685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5f40fa5b-d03d-4b6a-8747-4f5a9bf0870a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:08.737047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f40fa5b-d03d-4b6a-8747-4f5a9bf0870a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:56:08.740802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4461b08c-6c27-478a-ae2f-c59db8e89a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:56:08.741425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b08c-6c27-478a-ae2f-c59db8e89a01 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:08.741747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b08c-6c27-478a-ae2f-c59db8e89a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:08.742197 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4461b08c-6c27-478a-ae2f-c59db8e89a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:08.751903 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461b08c-6c27-478a-ae2f-c59db8e89a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:56:08.753948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4461b08c-6c27-478a-ae2f-c59db8e89a01 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:56:08.764603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 752/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:56:10.761027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701fd3-4c11-4831-b8a3-77b0d06896df None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:10.761613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701fd3-4c11-4831-b8a3-77b0d06896df None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:10.762066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11701fd3-4c11-4831-b8a3-77b0d06896df None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:10.764524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 779/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:56:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:56:10.771230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bde46-dca9-4c6d-b78c-aa39c6e9566d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:10.771806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bde46-dca9-4c6d-b78c-aa39c6e9566d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:10.771806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bde46-dca9-4c6d-b78c-aa39c6e9566d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:10.798626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-259bde46-dca9-4c6d-b78c-aa39c6e9566d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:56:10.799917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-259bde46-dca9-4c6d-b78c-aa39c6e9566d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:10.808094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 753/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:56:11.109532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11701fd3-4c11-4831-b8a3-77b0d06896df None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:56:11.112597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-11701fd3-4c11-4831-b8a3-77b0d06896df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:11.125043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11701fd3-4c11-4831-b8a3-77b0d06896df None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:56:11.129229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7440ddc-0ed1-427d-bccc-17688bcd8e98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:56:11.129857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440ddc-0ed1-427d-bccc-17688bcd8e98 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:11.130137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440ddc-0ed1-427d-bccc-17688bcd8e98 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:11.130424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7440ddc-0ed1-427d-bccc-17688bcd8e98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:11.143573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440ddc-0ed1-427d-bccc-17688bcd8e98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:56:11.145155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7440ddc-0ed1-427d-bccc-17688bcd8e98 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:56:11.155958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 780/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:56:14.663707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac865-7a29-4896-a3fd-d1981613e4fe None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:14.664288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac865-7a29-4896-a3fd-d1981613e4fe None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:14.664288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceac865-7a29-4896-a3fd-d1981613e4fe None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:14.665756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 754/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:56:14.672003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cd03e-7ccb-47a9-997f-baea14e418d4 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:14.672691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cd03e-7ccb-47a9-997f-baea14e418d4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:14.672691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3cd03e-7ccb-47a9-997f-baea14e418d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:14.681015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=81 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:14.694302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4b3cd03e-7ccb-47a9-997f-baea14e418d4 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:56:14.702065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4b3cd03e-7ccb-47a9-997f-baea14e418d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:14.703704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 781/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:56:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:56:15.276600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceac865-7a29-4896-a3fd-d1981613e4fe None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:56:15.278318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5ceac865-7a29-4896-a3fd-d1981613e4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:15.350644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:15.367618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceac865-7a29-4896-a3fd-d1981613e4fe None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:56:15.371592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11491e96-3744-4424-b7ef-d32581aa7461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:56:15.372228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491e96-3744-4424-b7ef-d32581aa7461 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:15.372512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491e96-3744-4424-b7ef-d32581aa7461 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:15.372789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11491e96-3744-4424-b7ef-d32581aa7461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:15.384057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11491e96-3744-4424-b7ef-d32581aa7461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:56:15.385624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11491e96-3744-4424-b7ef-d32581aa7461 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:56:15.400467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 755/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:56:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:56:17.424412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4948a2-106b-4c43-8a0e-0fe1f2a5ab41 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:17.425000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4948a2-106b-4c43-8a0e-0fe1f2a5ab41 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:17.425000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4948a2-106b-4c43-8a0e-0fe1f2a5ab41 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:17.426420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 782/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 24 06:56:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:56:17.434267 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1255664-dd10-4881-a400-f80dd212dcff None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:17.434805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1255664-dd10-4881-a400-f80dd212dcff None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:17.434960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1255664-dd10-4881-a400-f80dd212dcff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:17.455470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a1255664-dd10-4881-a400-f80dd212dcff None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:56:17.456703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a1255664-dd10-4881-a400-f80dd212dcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:17.464608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 756/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 24 06:56:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:56:18.028764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4948a2-106b-4c43-8a0e-0fe1f2a5ab41 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:56:18.030693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3f4948a2-106b-4c43-8a0e-0fe1f2a5ab41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:56:18.044723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4948a2-106b-4c43-8a0e-0fe1f2a5ab41 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:56:18.048989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245f3c04-55f4-4db6-8b3c-5904495ae9a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:56:18.049607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f3c04-55f4-4db6-8b3c-5904495ae9a0 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:56:18.049883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f3c04-55f4-4db6-8b3c-5904495ae9a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:56:18.050153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245f3c04-55f4-4db6-8b3c-5904495ae9a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:56:18.060278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f3c04-55f4-4db6-8b3c-5904495ae9a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:56:18.061752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245f3c04-55f4-4db6-8b3c-5904495ae9a0 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:56:18.072826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 783/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:56:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:56:27.449889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=11 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:56:28.067938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=8 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:47.132209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a76cf5-5a11-45ae-887d-8db69efc3b8b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.133476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a76cf5-5a11-45ae-887d-8db69efc3b8b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.133476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a76cf5-5a11-45ae-887d-8db69efc3b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.163215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-56a76cf5-5a11-45ae-887d-8db69efc3b8b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:47.164448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-56a76cf5-5a11-45ae-887d-8db69efc3b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:47.177705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 757/1540] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:57:47.187470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0f7f-a12d-4dab-b084-06133a3898a0 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.188048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0f7f-a12d-4dab-b084-06133a3898a0 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.188048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b0f7f-a12d-4dab-b084-06133a3898a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.217507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6a6b0f7f-a12d-4dab-b084-06133a3898a0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:47.218731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6a6b0f7f-a12d-4dab-b084-06133a3898a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:47.234030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 784/1541] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:47.238452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a76cf5-5a11-45ae-887d-8db69efc3b8b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:47.254078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a76cf5-5a11-45ae-887d-8db69efc3b8b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:47.262558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:47.263219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.263505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.263785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.264444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:47.264754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:47.266379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:47.293486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 758/1542] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:47.301620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b0f7f-a12d-4dab-b084-06133a3898a0 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:47.316788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b0f7f-a12d-4dab-b084-06133a3898a0 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:47.322093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9503cb-c1f9-4aef-bcc1-895d02b79ad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:47.322700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9503cb-c1f9-4aef-bcc1-895d02b79ad9 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.331512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9503cb-c1f9-4aef-bcc1-895d02b79ad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.331847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9503cb-c1f9-4aef-bcc1-895d02b79ad9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.332501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9503cb-c1f9-4aef-bcc1-895d02b79ad9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:47.334450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9503cb-c1f9-4aef-bcc1-895d02b79ad9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:47.502688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 785/1543] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/projects => generated 373 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:47.506791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:47.525432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52cb20-4072-4975-aea2-1e2efbabb4a3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:47.546944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b1f6-aeb1-4070-9713-3a778c486789 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.547308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b1f6-aeb1-4070-9713-3a778c486789 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.547514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe1b1f6-aeb1-4070-9713-3a778c486789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.601272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-cbe1b1f6-aeb1-4070-9713-3a778c486789 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:47.604854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cbe1b1f6-aeb1-4070-9713-3a778c486789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:47.685327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:47.685951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.686238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.686519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.687211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:47.689810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:47.766406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 786/1544] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:57:47.777705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065de06-f219-479b-bc0f-dd6f63496a8c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.778313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065de06-f219-479b-bc0f-dd6f63496a8c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.778789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f065de06-f219-479b-bc0f-dd6f63496a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.799492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 759/1545] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/users => generated 287 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:47.804746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:47.812544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f065de06-f219-479b-bc0f-dd6f63496a8c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:47.814111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f065de06-f219-479b-bc0f-dd6f63496a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:47.823333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d3559-f2a4-4438-9ac7-6a894b11a6f9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:47.831340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 787/1546] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:47.835752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065de06-f219-479b-bc0f-dd6f63496a8c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:47.837625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bb452-3312-41e8-8219-05fc72877181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:47.838647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb452-3312-41e8-8219-05fc72877181 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.838964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb452-3312-41e8-8219-05fc72877181 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.839242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bb452-3312-41e8-8219-05fc72877181 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.839902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb452-3312-41e8-8219-05fc72877181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:47.841523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bb452-3312-41e8-8219-05fc72877181 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:47.853135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f065de06-f219-479b-bc0f-dd6f63496a8c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:47.863386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:47.864346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.864810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 760/1547] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:47.865143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.865604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.866111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127009d-a892-45c1-8df2-2efc78136967 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.866399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127009d-a892-45c1-8df2-2efc78136967 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.866681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127009d-a892-45c1-8df2-2efc78136967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.868976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:47.871044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:47.872313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING py.warnings [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:57:47.872313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: warnings.warn(msg) Aug 24 06:57:47.872313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: Aug 24 06:57:47.873602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:47.896987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 788/1548] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:57:47.898294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:47.913309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b127009d-a892-45c1-8df2-2efc78136967 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:47.914546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b127009d-a892-45c1-8df2-2efc78136967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:47.917749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e65c2e-7c78-4b32-976d-9756dbf7e45c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:47.939517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b115f8f8-c43d-4aee-bd30-233ee2a06762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:47.940469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115f8f8-c43d-4aee-bd30-233ee2a06762 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.940967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115f8f8-c43d-4aee-bd30-233ee2a06762 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.941362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 761/1549] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:47.941718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b115f8f8-c43d-4aee-bd30-233ee2a06762 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.942207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127009d-a892-45c1-8df2-2efc78136967 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:47.943108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115f8f8-c43d-4aee-bd30-233ee2a06762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:47.945076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b115f8f8-c43d-4aee-bd30-233ee2a06762 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:47.960755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 789/1550] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:47 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:47.960956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127009d-a892-45c1-8df2-2efc78136967 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:47.968898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300570b4-a84a-4d0a-9cef-e520c25ea8e1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.968898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300570b4-a84a-4d0a-9cef-e520c25ea8e1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.968898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300570b4-a84a-4d0a-9cef-e520c25ea8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.971876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2a65ff-fa4e-4027-a7b0-0ddf2e1a55b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:47.973690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a65ff-fa4e-4027-a7b0-0ddf2e1a55b4 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:47.975643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a65ff-fa4e-4027-a7b0-0ddf2e1a55b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:47.976113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2a65ff-fa4e-4027-a7b0-0ddf2e1a55b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:47.976967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a65ff-fa4e-4027-a7b0-0ddf2e1a55b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:47.980388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-3d2a65ff-fa4e-4027-a7b0-0ddf2e1a55b4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:57:47.980388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:57:47.980388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:57:47.982130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2a65ff-fa4e-4027-a7b0-0ddf2e1a55b4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.005760 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-300570b4-a84a-4d0a-9cef-e520c25ea8e1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.007606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-300570b4-a84a-4d0a-9cef-e520c25ea8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.021535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 790/1551] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.022951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1878e-fd1c-497e-aff5-fca72fa58043 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.023527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1878e-fd1c-497e-aff5-fca72fa58043 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.023811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d1878e-fd1c-497e-aff5-fca72fa58043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.044712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-e6d1878e-fd1c-497e-aff5-fca72fa58043 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.045938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e6d1878e-fd1c-497e-aff5-fca72fa58043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.054027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 791/1552] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.054874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1878e-fd1c-497e-aff5-fca72fa58043 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.064514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d1878e-fd1c-497e-aff5-fca72fa58043 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.069226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bfa6fb-bbef-4022-a79d-c51131c16d46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.069885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa6fb-bbef-4022-a79d-c51131c16d46 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.070172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa6fb-bbef-4022-a79d-c51131c16d46 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.070453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bfa6fb-bbef-4022-a79d-c51131c16d46 admin admin] PATH_INFO: `/v3/projects/169e85d3dfde4cbcbd065effc3d76f67/users/bf4a8e785f574be28733a0c457edc115/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.084910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 762/1553] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:47 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:48.085121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfa6fb-bbef-4022-a79d-c51131c16d46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=169e85d3dfde4cbcbd065effc3d76f67, user_id=bf4a8e785f574be28733a0c457edc115, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.086615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff139c-240f-4b0e-aa1f-055bab5e4e4f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.086938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff139c-240f-4b0e-aa1f-055bab5e4e4f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.087219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ff139c-240f-4b0e-aa1f-055bab5e4e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.087875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bfa6fb-bbef-4022-a79d-c51131c16d46 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.108359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-99ff139c-240f-4b0e-aa1f-055bab5e4e4f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.109523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-99ff139c-240f-4b0e-aa1f-055bab5e4e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.152144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 792/1554] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:48 2022] PUT /identity/v3/projects/169e85d3dfde4cbcbd065effc3d76f67/users/bf4a8e785f574be28733a0c457edc115/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:48.153398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff907e22-af2d-48e1-aa9f-3dcf2c7a7f3d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.153683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff907e22-af2d-48e1-aa9f-3dcf2c7a7f3d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.153960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff907e22-af2d-48e1-aa9f-3dcf2c7a7f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.170438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 763/1555] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.178376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cbd3f-f3cc-40db-8250-284f0633f489 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.178376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cbd3f-f3cc-40db-8250-284f0633f489 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.178376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595cbd3f-f3cc-40db-8250-284f0633f489 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.183016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ff907e22-af2d-48e1-aa9f-3dcf2c7a7f3d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.184951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ff907e22-af2d-48e1-aa9f-3dcf2c7a7f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.191936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-595cbd3f-f3cc-40db-8250-284f0633f489 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.193169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-595cbd3f-f3cc-40db-8250-284f0633f489 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.221144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:48.236415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:48.247739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 793/1556] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.249103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198ac4-83bd-4af1-8277-53c4b57f3574 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.249560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198ac4-83bd-4af1-8277-53c4b57f3574 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.249973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198ac4-83bd-4af1-8277-53c4b57f3574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.259679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 764/1557] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.259925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cbd3f-f3cc-40db-8250-284f0633f489 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.269937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595cbd3f-f3cc-40db-8250-284f0633f489 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.272524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-88198ac4-83bd-4af1-8277-53c4b57f3574 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.273766 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-88198ac4-83bd-4af1-8277-53c4b57f3574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.274683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.275321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.275604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.276436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.277335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:48.277639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.279268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.283710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 794/1558] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.288292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bfccf-6d59-4987-95ff-9a3cdacad4aa None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.288292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bfccf-6d59-4987-95ff-9a3cdacad4aa None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.288292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1bfccf-6d59-4987-95ff-9a3cdacad4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.298740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 765/1559] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:48.298740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.302897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf961f-e003-49da-bdba-274e46e42513 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.308699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3efd6-e03d-46bc-8510-1a1de167495e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.309512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3efd6-e03d-46bc-8510-1a1de167495e admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.315260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3efd6-e03d-46bc-8510-1a1de167495e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.315260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3efd6-e03d-46bc-8510-1a1de167495e admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.315483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9c1bfccf-6d59-4987-95ff-9a3cdacad4aa None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.315592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3efd6-e03d-46bc-8510-1a1de167495e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.315694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9c1bfccf-6d59-4987-95ff-9a3cdacad4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.315795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3efd6-e03d-46bc-8510-1a1de167495e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.319633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 795/1560] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.323518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc02cd-fb6e-4225-902c-7a32fcae8d13 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.323518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc02cd-fb6e-4225-902c-7a32fcae8d13 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.323518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc02cd-fb6e-4225-902c-7a32fcae8d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.351939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-94cc02cd-fb6e-4225-902c-7a32fcae8d13 None None] MFA Rules not processed for user `bf4a8e785f574be28733a0c457edc115`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.353173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-94cc02cd-fb6e-4225-902c-7a32fcae8d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.398070 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 766/1561] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:48.399284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb38d0-c3fb-49bc-b907-b43962b30523 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.399581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb38d0-c3fb-49bc-b907-b43962b30523 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.399864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb38d0-c3fb-49bc-b907-b43962b30523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.420339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 796/1562] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.421080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-67cb38d0-c3fb-49bc-b907-b43962b30523 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.421587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dcff2-c0b8-411d-87c8-736184f2fa1a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.422009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dcff2-c0b8-411d-87c8-736184f2fa1a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.422273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-67cb38d0-c3fb-49bc-b907-b43962b30523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.422380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dcff2-c0b8-411d-87c8-736184f2fa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.431515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 767/1563] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.432758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78acf-0068-4924-93f6-bd654d99cf26 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.433049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78acf-0068-4924-93f6-bd654d99cf26 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.433328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b78acf-0068-4924-93f6-bd654d99cf26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.450802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-1a0dcff2-c0b8-411d-87c8-736184f2fa1a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.452344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1a0dcff2-c0b8-411d-87c8-736184f2fa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.456894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a3b78acf-0068-4924-93f6-bd654d99cf26 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.458357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a3b78acf-0068-4924-93f6-bd654d99cf26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.461067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 797/1564] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.461832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dcff2-c0b8-411d-87c8-736184f2fa1a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.467967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 768/1565] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.470038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b78acf-0068-4924-93f6-bd654d99cf26 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.475058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dcff2-c0b8-411d-87c8-736184f2fa1a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.479123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b78acf-0068-4924-93f6-bd654d99cf26 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.479763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f85fcf-7d37-4417-9cb4-c87c90ddb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.480375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85fcf-7d37-4417-9cb4-c87c90ddb8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.480664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85fcf-7d37-4417-9cb4-c87c90ddb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.480963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f85fcf-7d37-4417-9cb4-c87c90ddb8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.481615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f85fcf-7d37-4417-9cb4-c87c90ddb8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:48.481918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f85fcf-7d37-4417-9cb4-c87c90ddb8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.483563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f85fcf-7d37-4417-9cb4-c87c90ddb8b0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.484176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2ecf2a-38cf-485a-b676-0c1d88d2d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.484791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ecf2a-38cf-485a-b676-0c1d88d2d9e4 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.485072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ecf2a-38cf-485a-b676-0c1d88d2d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.485344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2ecf2a-38cf-485a-b676-0c1d88d2d9e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.485985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ecf2a-38cf-485a-b676-0c1d88d2d9e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.487963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2ecf2a-38cf-485a-b676-0c1d88d2d9e4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.495902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 798/1566] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:48.497249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2d04-eb32-46a5-a58c-1dfe1bfc1e54 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.497536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2d04-eb32-46a5-a58c-1dfe1bfc1e54 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.497991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bf2d04-eb32-46a5-a58c-1dfe1bfc1e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.518988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-e7bf2d04-eb32-46a5-a58c-1dfe1bfc1e54 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.520200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e7bf2d04-eb32-46a5-a58c-1dfe1bfc1e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.530005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 799/1567] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.530792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2d04-eb32-46a5-a58c-1dfe1bfc1e54 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.540380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bf2d04-eb32-46a5-a58c-1dfe1bfc1e54 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.545680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.546348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.546634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.546968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.547606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.549198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.559490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 800/1568] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:48.560261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.569464 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ad136b-1554-4b05-9f00-5dc03f90e940 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.575030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.575621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.575905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.579562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 769/1569] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:48.579714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.579714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:48.579714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.580002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c26b-0fee-437f-9a05-25b15c0fcf1a None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.580002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c26b-0fee-437f-9a05-25b15c0fcf1a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.580002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd4c26b-0fee-437f-9a05-25b15c0fcf1a None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.580362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.580465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 770/1570] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 06:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:57:48.580984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c26b-0fee-437f-9a05-25b15c0fcf1a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.595099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 801/1571] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:48.595939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.606013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fd5964-6f5c-45b3-b0e6-80fed6d38a0f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.648284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd4c26b-0fee-437f-9a05-25b15c0fcf1a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.654139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.654777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.655072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.655357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.656021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:48.656431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.658063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.663568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.664301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.664679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.665027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.665831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:48.666145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.667819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.671151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 771/1572] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:48.672056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.684202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fae8cef-331d-44b4-8ae8-82709e9a8e13 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.684868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 802/1573] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:48.685643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.689215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f439925-7dbe-4cca-a41b-f71074391f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.689827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439925-7dbe-4cca-a41b-f71074391f2f admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.690110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439925-7dbe-4cca-a41b-f71074391f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.690387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f439925-7dbe-4cca-a41b-f71074391f2f admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.691070 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f439925-7dbe-4cca-a41b-f71074391f2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.693670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f439925-7dbe-4cca-a41b-f71074391f2f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.696916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a488c5-9109-495b-997d-9c4d999164c0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.702550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.703171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.703456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.703736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.704386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:48.704734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.706358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.719985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 803/1574] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:48.720984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.726089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:48.731706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0661d8-02bd-4fd4-af86-22532e94fc56 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.736400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.737001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.737327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.737612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.738288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.739936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.750945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 804/1575] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:48.751930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.762294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e65ef-cc3b-4238-a9b4-f96e08cbc9c0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.766998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.767580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.767865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.768141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.768767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.769772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING py.warnings [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:57:48.769772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: warnings.warn(msg) Aug 24 06:57:48.769772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: Aug 24 06:57:48.771023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.807867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 772/1576] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/projects => generated 377 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:48.807867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88dd66-ebb4-4a26-9e45-3d477c92ad8a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.807867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88dd66-ebb4-4a26-9e45-3d477c92ad8a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.807867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be88dd66-ebb4-4a26-9e45-3d477c92ad8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.843918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-be88dd66-ebb4-4a26-9e45-3d477c92ad8a None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:48.845175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-be88dd66-ebb4-4a26-9e45-3d477c92ad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:48.863668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:48.865528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 805/1577] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/users => generated 284 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:48.865859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.876625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5878c902-dae5-4051-b59e-5fd8464aeb74 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.914049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 773/1578] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:48.915181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88dd66-ebb4-4a26-9e45-3d477c92ad8a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:48.936512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.937135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.937422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.937703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.938339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.940317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:48.977171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be88dd66-ebb4-4a26-9e45-3d477c92ad8a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:48.982510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:48.983159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:48.983522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:48.983800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:48.984453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:48.986415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.015065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 806/1579] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.016078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.064921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 774/1580] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:48 2022] POST /identity/v3/projects => generated 393 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.064921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.078251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343a798-40c7-404a-8781-a508493466e0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.127788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b051a687-a606-420a-be77-00d087ef49db admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.132543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.133296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.133566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.133844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.134482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.136024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.136464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.136632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.136918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.137191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.137816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.139767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.150579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:49.215800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 775/1581] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.216681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.238982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 807/1582] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.245177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.247976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:49.280471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee97ec0-78ed-4dcf-b77f-05f7b5ef23ef admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.303061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f7290-9aa7-437c-b96b-ee45ffe5a61c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.308526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.313347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.313347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.313347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.313347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.313347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.336534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.339653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.339653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.339653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] PATH_INFO: `/v3/projects/9179f3fa1f09430cb8b17d8746615ad9/users/274a8b1be49747a4862fb8e14de8d595/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.353638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9179f3fa1f09430cb8b17d8746615ad9, user_id=274a8b1be49747a4862fb8e14de8d595, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.355306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:57:49.355306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:57:49.355306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:57:49.357293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.420478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 808/1583] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.421305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.430511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae164814-1744-4bec-a135-cdab0c0f5168 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.435173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.435746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.436030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.436299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.436923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.438499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.448821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 809/1584] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:49.449587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.465747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 776/1585] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:49 2022] PUT /identity/v3/projects/9179f3fa1f09430cb8b17d8746615ad9/users/274a8b1be49747a4862fb8e14de8d595/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:49.467029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.529155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad9fd02-20dc-472b-aee4-00328cdc6d7d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.532515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a596822c-18f4-494e-8f68-56434ff6f333 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.534344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.534976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.535257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.535529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.536221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.538182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.595931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.596540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.596824 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.597100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.601257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:49.636974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 777/1586] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/users => generated 294 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.637878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.655238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a288167-3fff-48dc-8f60-438ff9cdabe0 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.656902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.658897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.660398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.661807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.662100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.662381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.663190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.665016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.670092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 810/1587] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:49.671101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.683327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576f9d63-191b-4ac3-a9c7-9a6fcb64cc57 service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.688236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.688826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.689210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.689504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.690125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.692052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.785709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 778/1588] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/users => generated 297 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.786718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.796649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de9c37-4b91-451e-b242-bcdc6626a8a0 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.801470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.802062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.802347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.802625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.803291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.805404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.813034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 811/1589] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/users => generated 291 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.814229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.826616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1ecb26-c8a3-427e-9870-a58a9ac0f200 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.831244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.831837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.832115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.832392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.833023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.834654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.845366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 812/1590] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:49.846097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.857781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c7ca71-fa0f-498c-b310-f6c80fc7496e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.862620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d262dec-556e-4050-84fc-0856efeb9848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.863244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d262dec-556e-4050-84fc-0856efeb9848 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.863524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d262dec-556e-4050-84fc-0856efeb9848 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.863799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d262dec-556e-4050-84fc-0856efeb9848 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.864461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d262dec-556e-4050-84fc-0856efeb9848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.866060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d262dec-556e-4050-84fc-0856efeb9848 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.877923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 813/1591] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:49.879443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ce13-ab52-4ca9-823b-93117b07a9e5 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.879835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ce13-ab52-4ca9-823b-93117b07a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.880211 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea63ce13-ab52-4ca9-823b-93117b07a9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.899520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 779/1592] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:49.899520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.908028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b006a-45a6-40ae-8e2a-8a1713b93bbb admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.913442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.914168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.914522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.914909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.915635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.919077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.919296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ea63ce13-ab52-4ca9-823b-93117b07a9e5 None None] MFA Rules not processed for user `274a8b1be49747a4862fb8e14de8d595`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:49.920529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ea63ce13-ab52-4ca9-823b-93117b07a9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:49.923695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:49.932576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 780/1593] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:49.932576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.940781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4af15a-15a3-4dc4-bc07-f03a916f1ca0 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.945442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.946144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.946429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.946708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.947393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.949618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.959622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 781/1594] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:49.960574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.971655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d97e43-4c68-4861-954d-c9ea92a18def admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:49.976441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:49.977053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:49.977338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:49.978201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:49.978346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:49.980018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:49.988288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 814/1595] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:49.997588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 782/1596] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:49.997588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:49.997919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ce13-ab52-4ca9-823b-93117b07a9e5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.006487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea63ce13-ab52-4ca9-823b-93117b07a9e5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.009806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4255b87c-cd09-4d65-8d4f-eaebc42f6ecf admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.013186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.013696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.013977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.014354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.014939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.016491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.016631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.017160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.017447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.017743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] PATH_INFO: `/v3/projects/ab46cad9935f4c6f8300388306c58573/users/9865106c152149e48033ef8f78467e1b/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.029506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 815/1597] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:50.030354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.037047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab46cad9935f4c6f8300388306c58573, user_id=9865106c152149e48033ef8f78467e1b, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.039975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.040711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f81c44-ba0a-4442-8c7e-a73efa21817b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.045547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d6ccf-4984-46ae-b18d-49cae5b88d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.046135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6ccf-4984-46ae-b18d-49cae5b88d3f admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.046460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6ccf-4984-46ae-b18d-49cae5b88d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.046735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d6ccf-4984-46ae-b18d-49cae5b88d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.047400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d6ccf-4984-46ae-b18d-49cae5b88d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.048980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d6ccf-4984-46ae-b18d-49cae5b88d3f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.059363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 816/1598] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:50.060533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73655289-dd67-40fa-a3a2-c7147350510c None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.060814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73655289-dd67-40fa-a3a2-c7147350510c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.061087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73655289-dd67-40fa-a3a2-c7147350510c None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.062665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 817/1599] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 06:57:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:57:50.063046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73655289-dd67-40fa-a3a2-c7147350510c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.075876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73655289-dd67-40fa-a3a2-c7147350510c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.080335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.080907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.082119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.082119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.082119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.083656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.093904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 818/1600] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:50.094669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.103905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc983880-ea17-4fde-943d-2b0b0206cc16 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.106370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 783/1601] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:49 2022] PUT /identity/v3/projects/ab46cad9935f4c6f8300388306c58573/users/9865106c152149e48033ef8f78467e1b/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:50.107365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.128308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:50.167049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc1087-d5c6-47b5-88f3-b58336141427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.167677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1087-d5c6-47b5-88f3-b58336141427 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.168106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1087-d5c6-47b5-88f3-b58336141427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.168388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc1087-d5c6-47b5-88f3-b58336141427 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.169082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc1087-d5c6-47b5-88f3-b58336141427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.170905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc1087-d5c6-47b5-88f3-b58336141427 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.179965 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b12c96-496d-4d3a-9db5-95df205c5503 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.181592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 819/1602] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:50.185639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69b640-cb11-47b4-8bb7-243d9a980501 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.185639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69b640-cb11-47b4-8bb7-243d9a980501 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.185639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c69b640-cb11-47b4-8bb7-243d9a980501 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.185639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 820/1603] 10.222.0.59 () {54 vars in 962 bytes} [Wed Aug 24 06:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:57:50.185639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69b640-cb11-47b4-8bb7-243d9a980501 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.188806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.189469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.189744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.190141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.190835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.192558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.201313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c69b640-cb11-47b4-8bb7-243d9a980501 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.203682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 784/1604] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:50.204529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.209964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.214206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.214206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.214206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] PATH_INFO: `/v3/projects/63e9ae8ffd464426871f97ba03dab036/users/9e77780ae7d749f19d6840f69626b236/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.218974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07adca5-b9f2-4192-9f36-b44ed0409b85 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.224276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ff085c-2cd1-4212-b7a6-d7ebf9a4afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.224910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff085c-2cd1-4212-b7a6-d7ebf9a4afa4 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.225220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff085c-2cd1-4212-b7a6-d7ebf9a4afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.225511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ff085c-2cd1-4212-b7a6-d7ebf9a4afa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.226205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff085c-2cd1-4212-b7a6-d7ebf9a4afa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.227842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ff085c-2cd1-4212-b7a6-d7ebf9a4afa4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.229929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=63e9ae8ffd464426871f97ba03dab036, user_id=9e77780ae7d749f19d6840f69626b236, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.232698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.239208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 785/1605] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:50.240607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3fa0-c801-43cd-87c3-c021cd4386bd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.241164 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3fa0-c801-43cd-87c3-c021cd4386bd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.241724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ab3fa0-c801-43cd-87c3-c021cd4386bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.264731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-94ab3fa0-c801-43cd-87c3-c021cd4386bd None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:50.265966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-94ab3fa0-c801-43cd-87c3-c021cd4386bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:50.310900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 821/1606] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:50 2022] PUT /identity/v3/projects/63e9ae8ffd464426871f97ba03dab036/users/9e77780ae7d749f19d6840f69626b236/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:50.312426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.337428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 786/1607] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:50.339313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270fbba-4816-4660-99bf-4be12fb8564c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.339602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270fbba-4816-4660-99bf-4be12fb8564c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.339877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2270fbba-4816-4660-99bf-4be12fb8564c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.370170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-2270fbba-4816-4660-99bf-4be12fb8564c None None] MFA Rules not processed for user `9865106c152149e48033ef8f78467e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:50.371516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2270fbba-4816-4660-99bf-4be12fb8564c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:50.380253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cf8a1b-5f63-4f48-bdb1-74756a6a24fe admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.385126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35d0453-1149-43e6-bf25-5b0207564cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.385769 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0453-1149-43e6-bf25-5b0207564cc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.386048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0453-1149-43e6-bf25-5b0207564cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.386355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35d0453-1149-43e6-bf25-5b0207564cc1 admin admin] PATH_INFO: `/v3/projects/1e87020e3db0420cbd064383f9f0ed3a/users/024eb38f66684644b1d0b38b3f297ce8/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.390037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:50.401871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d0453-1149-43e6-bf25-5b0207564cc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e87020e3db0420cbd064383f9f0ed3a, user_id=024eb38f66684644b1d0b38b3f297ce8, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.404682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35d0453-1149-43e6-bf25-5b0207564cc1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.438909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 787/1608] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:50.439747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270fbba-4816-4660-99bf-4be12fb8564c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.450971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2270fbba-4816-4660-99bf-4be12fb8564c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.455838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.456497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.456780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.457058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] PATH_INFO: `/v3/projects/441ca39174f9445d920c45963e827f20/users/6a91e857dd3b4c1f9355b757cadd6bd0/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.471681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 822/1609] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:50 2022] PUT /identity/v3/projects/1e87020e3db0420cbd064383f9f0ed3a/users/024eb38f66684644b1d0b38b3f297ce8/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:50.475665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=441ca39174f9445d920c45963e827f20, user_id=6a91e857dd3b4c1f9355b757cadd6bd0, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.475789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15efe-f25a-47b5-a2f5-bc9571097086 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.475789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15efe-f25a-47b5-a2f5-bc9571097086 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.475789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f15efe-f25a-47b5-a2f5-bc9571097086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.476009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.493212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d0f15efe-f25a-47b5-a2f5-bc9571097086 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:50.494430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d0f15efe-f25a-47b5-a2f5-bc9571097086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:50.556178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 788/1610] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:50 2022] PUT /identity/v3/projects/441ca39174f9445d920c45963e827f20/users/6a91e857dd3b4c1f9355b757cadd6bd0/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:50.557304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.566035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 823/1611] 10.222.0.59 () {58 vars in 1059 bytes} [Wed Aug 24 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:50.566793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f15efe-f25a-47b5-a2f5-bc9571097086 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.576869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:50.626343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd3145e-06d0-47b3-84df-ecb46db7f6fe admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.627998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f15efe-f25a-47b5-a2f5-bc9571097086 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.631069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd713ef7-75f2-4b0f-bf3f-4d03c8d296f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.631734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd713ef7-75f2-4b0f-bf3f-4d03c8d296f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.632027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd713ef7-75f2-4b0f-bf3f-4d03c8d296f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.632296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd713ef7-75f2-4b0f-bf3f-4d03c8d296f6 admin admin] PATH_INFO: `/v3/projects/ac1d7af4d7214d0c88a3d06e2a9e9117/users/ac96056339554c41b4f42af19770191c/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.632549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.633208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.633490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.633766 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] PATH_INFO: `/v3/projects/9349d644a2c243d4bcf524e28904b44c/users/d4d67302dacd48d0a4d957b2d5a66fe0/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.649176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd713ef7-75f2-4b0f-bf3f-4d03c8d296f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1d7af4d7214d0c88a3d06e2a9e9117, user_id=ac96056339554c41b4f42af19770191c, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.651320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=9349d644a2c243d4bcf524e28904b44c, user_id=d4d67302dacd48d0a4d957b2d5a66fe0, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.652930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd713ef7-75f2-4b0f-bf3f-4d03c8d296f6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.654317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.762467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 789/1612] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:50 2022] PUT /identity/v3/projects/ac1d7af4d7214d0c88a3d06e2a9e9117/users/ac96056339554c41b4f42af19770191c/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:50.762467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d37c9-e6c3-4f72-ad80-436bc7f529b1 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.762467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d37c9-e6c3-4f72-ad80-436bc7f529b1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.762467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1d37c9-e6c3-4f72-ad80-436bc7f529b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.763004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 824/1613] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:50 2022] PUT /identity/v3/projects/9349d644a2c243d4bcf524e28904b44c/users/d4d67302dacd48d0a4d957b2d5a66fe0/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:50.763004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.776927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-9c1d37c9-e6c3-4f72-ad80-436bc7f529b1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:50.778189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9c1d37c9-e6c3-4f72-ad80-436bc7f529b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:50.826175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bc7f70-f100-4822-93e7-ffb7ab7346fd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.829899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff7f7ba-16af-460c-bf0d-3bf0e2ed61c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.830560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f7ba-16af-460c-bf0d-3bf0e2ed61c8 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.830882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f7ba-16af-460c-bf0d-3bf0e2ed61c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.831157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff7f7ba-16af-460c-bf0d-3bf0e2ed61c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.838550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 790/1614] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:50.839640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d37c9-e6c3-4f72-ad80-436bc7f529b1 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.848644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1d37c9-e6c3-4f72-ad80-436bc7f529b1 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.852295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907c22c0-c4f4-4bc5-874d-80dcce88f291 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.852898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c22c0-c4f4-4bc5-874d-80dcce88f291 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.853178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c22c0-c4f4-4bc5-874d-80dcce88f291 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.853454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907c22c0-c4f4-4bc5-874d-80dcce88f291 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.870588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:50.909219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f7ba-16af-460c-bf0d-3bf0e2ed61c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.910686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff7f7ba-16af-460c-bf0d-3bf0e2ed61c8 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.917061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c22c0-c4f4-4bc5-874d-80dcce88f291 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:50.921076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907c22c0-c4f4-4bc5-874d-80dcce88f291 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:50.921972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 825/1615] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:50.923239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ca0a-8178-456a-bba6-1433da49321c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.923905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ca0a-8178-456a-bba6-1433da49321c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.923905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b9ca0a-8178-456a-bba6-1433da49321c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.930779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 791/1616] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:50.932701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ba4a-7e54-4f5e-89c4-41915b7b9f47 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.932898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ba4a-7e54-4f5e-89c4-41915b7b9f47 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.933310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e2ba4a-7e54-4f5e-89c4-41915b7b9f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.944585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a8b9ca0a-8178-456a-bba6-1433da49321c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:50.945978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a8b9ca0a-8178-456a-bba6-1433da49321c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:50.955076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 826/1617] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:50.955596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-90e2ba4a-7e54-4f5e-89c4-41915b7b9f47 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:50.956076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ca0a-8178-456a-bba6-1433da49321c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:50.956840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-90e2ba4a-7e54-4f5e-89c4-41915b7b9f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:50.969091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b9ca0a-8178-456a-bba6-1433da49321c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:50.975368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385b987-dbab-48a5-9e2b-bfd4af2d92b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:50.976088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385b987-dbab-48a5-9e2b-bfd4af2d92b8 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.976435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385b987-dbab-48a5-9e2b-bfd4af2d92b8 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.976775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385b987-dbab-48a5-9e2b-bfd4af2d92b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:50.978927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 792/1618] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:50.980380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c42e-9318-4892-a725-357df61d3430 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:50.980626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c42e-9318-4892-a725-357df61d3430 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:50.980913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd0c42e-9318-4892-a725-357df61d3430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.009517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:51.019946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-afd0c42e-9318-4892-a725-357df61d3430 None None] MFA Rules not processed for user `ac96056339554c41b4f42af19770191c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:51.022055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-afd0c42e-9318-4892-a725-357df61d3430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:51.051174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385b987-dbab-48a5-9e2b-bfd4af2d92b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.052889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385b987-dbab-48a5-9e2b-bfd4af2d92b8 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.063837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 827/1619] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:51.065104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fdd2d-f679-4b04-a958-574adae108ce None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.065465 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fdd2d-f679-4b04-a958-574adae108ce None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.065797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235fdd2d-f679-4b04-a958-574adae108ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.100806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-235fdd2d-f679-4b04-a958-574adae108ce None None] MFA Rules not processed for user `d4d67302dacd48d0a4d957b2d5a66fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:51.103008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-235fdd2d-f679-4b04-a958-574adae108ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:51.145621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 793/1620] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:51.150107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0c42e-9318-4892-a725-357df61d3430 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.196381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 828/1621] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:51.202792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fdd2d-f679-4b04-a958-574adae108ce None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.250795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd0c42e-9318-4892-a725-357df61d3430 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.255272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.261030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.261030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.261030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.267163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.269047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.281645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 794/1622] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:51.282953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.295393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6d69-87ec-472b-8f72-a7c4231de644 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.303830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.304455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.304734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.305006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.311843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235fdd2d-f679-4b04-a958-574adae108ce None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.316214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589584b-336e-4cfb-a336-3a2322b19a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.316999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589584b-336e-4cfb-a336-3a2322b19a6a service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.317447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589584b-336e-4cfb-a336-3a2322b19a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.317814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589584b-336e-4cfb-a336-3a2322b19a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.329583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.329802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589584b-336e-4cfb-a336-3a2322b19a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.329910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.330584 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589584b-336e-4cfb-a336-3a2322b19a6a service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.340632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 795/1623] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:51.341430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 829/1624] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:51.341718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.349257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373c60-d3c3-4666-a31a-26540e70674e None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.349539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373c60-d3c3-4666-a31a-26540e70674e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.349825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08373c60-d3c3-4666-a31a-26540e70674e None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.351191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 830/1625] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 06:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 06:57:51.352124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5326214-39bb-4403-b9fd-76a16a08862a service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.357115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc22116-3789-47db-9c78-de7f7a3ba2b4 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.360775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc22116-3789-47db-9c78-de7f7a3ba2b4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.360775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc22116-3789-47db-9c78-de7f7a3ba2b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.362010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.362732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.363186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.363818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.364361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.366571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.379611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-bdc22116-3789-47db-9c78-de7f7a3ba2b4 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:51.380907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bdc22116-3789-47db-9c78-de7f7a3ba2b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:51.392317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 831/1626] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:57:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:57:51.463340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 796/1627] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:51 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:51.464447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc22116-3789-47db-9c78-de7f7a3ba2b4 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.475074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc22116-3789-47db-9c78-de7f7a3ba2b4 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.529502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:51.542548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.543201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.543670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.543904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.544809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.546860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.645626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 832/1628] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:51 2022] POST /identity/v3/users => generated 297 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:51.646957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.658108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14700e30-f5f7-41a0-91a4-65c7a473c5d9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.663294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.663920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.664205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.664485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.665148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.666791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.669282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:51.678020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 797/1629] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:51.682906 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.693257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef5813-d5d4-4a52-bae3-2fb774cc3716 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.699891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.700580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.700878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.701196 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] PATH_INFO: `/v3/projects/d0ed67036b884875ba45a72ec2f6bba6/users/e59198b41dd2488584fbf04b59dc8237/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.728684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ed67036b884875ba45a72ec2f6bba6, user_id=e59198b41dd2488584fbf04b59dc8237, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.732081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.804617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 833/1630] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:51 2022] PUT /identity/v3/projects/d0ed67036b884875ba45a72ec2f6bba6/users/e59198b41dd2488584fbf04b59dc8237/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:57:51.809932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.820446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffda695-9016-4dfc-b107-f53a87db4ccb admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.891590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43797610-8106-4f4b-8f43-54d5c5d6d42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.892360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797610-8106-4f4b-8f43-54d5c5d6d42c admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.892718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797610-8106-4f4b-8f43-54d5c5d6d42c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.893071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43797610-8106-4f4b-8f43-54d5c5d6d42c admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.893866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43797610-8106-4f4b-8f43-54d5c5d6d42c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.895521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43797610-8106-4f4b-8f43-54d5c5d6d42c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.906820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 798/1631] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:51 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:51.910927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:51.922267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997ba46-a387-42b5-9a28-8add09ac410d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:51.927828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:51.932688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.932688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.932688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] PATH_INFO: `/v3/projects/d0ed67036b884875ba45a72ec2f6bba6/users/e59198b41dd2488584fbf04b59dc8237/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.932688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ed67036b884875ba45a72ec2f6bba6, user_id=e59198b41dd2488584fbf04b59dc8237, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:51.934594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:51.946079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 834/1632] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:51 2022] PUT /identity/v3/projects/d0ed67036b884875ba45a72ec2f6bba6/users/e59198b41dd2488584fbf04b59dc8237/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:51.957068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8e31-18d4-47de-82f0-c48a1400b7bb None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:51.957357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8e31-18d4-47de-82f0-c48a1400b7bb None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:51.957638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d8e31-18d4-47de-82f0-c48a1400b7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:51.967253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:52.005991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a01d8e31-18d4-47de-82f0-c48a1400b7bb None None] MFA Rules not processed for user `e59198b41dd2488584fbf04b59dc8237`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:52.007542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a01d8e31-18d4-47de-82f0-c48a1400b7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:52.040509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d213a599-d071-4c02-a521-292e292230d8 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:52.047880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:52.048582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:52.048954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:52.049281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:52.097277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 799/1633] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:52.147682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:52.149613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:52.161680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 835/1634] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:53.124417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d8e31-18d4-47de-82f0-c48a1400b7bb None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:53.131628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:53.146198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d8e31-18d4-47de-82f0-c48a1400b7bb None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:53.154212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:53.155240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:53.155631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:53.156322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:53.156973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a9097e-2149-4d92-99a7-99e508fab87b service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:53.173637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:53.173637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:53.173847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:53.173847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:53.173847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:53.173847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:53.186827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 800/1635] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:53.253721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:53.273599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:53.275808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:53.286738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 836/1636] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:53.805062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:53.805062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d47df4-f05c-4796-add3-83f1032d2280 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:53.805062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb39aaf-23fa-42db-a8b9-4352de73688f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:53.805062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39aaf-23fa-42db-a8b9-4352de73688f service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:53.811486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39aaf-23fa-42db-a8b9-4352de73688f service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:53.811486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb39aaf-23fa-42db-a8b9-4352de73688f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:53.811486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39aaf-23fa-42db-a8b9-4352de73688f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:53.811486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb39aaf-23fa-42db-a8b9-4352de73688f service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:53.811486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 801/1637] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:54.810221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:54.963292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc2d55-d8b0-4a20-8b90-beb9adc56f09 service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:54.984994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:54.985673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:54.985959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:54.988410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] PATH_INFO: `/v3/users/d4d67302dacd48d0a4d957b2d5a66fe0` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:54.991627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4d67302dacd48d0a4d957b2d5a66fe0)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:54.997774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:55.381858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4d67302dacd48d0a4d957b2d5a66fe0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:55.382625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4d67302dacd48d0a4d957b2d5a66fe0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:55.503659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4d67302dacd48d0a4d957b2d5a66fe0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:55.542352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4d67302dacd48d0a4d957b2d5a66fe0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:55.595964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4d67302dacd48d0a4d957b2d5a66fe0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:55.608248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 837/1638] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:57:54 2022] DELETE /identity/v3/users/d4d67302dacd48d0a4d957b2d5a66fe0 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:55.615519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:55.619802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:55.621973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:55.639166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:55.692811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:55.700736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:55.891462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 802/1639] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:57:55.909001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:55.918512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:56.052266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c45ce78-3953-46db-8013-0ec9656d5f11 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:56.064076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0957337-c3c0-4844-86cb-2ce964c6046b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:56.064657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0957337-c3c0-4844-86cb-2ce964c6046b service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:56.064945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0957337-c3c0-4844-86cb-2ce964c6046b service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:56.065218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0957337-c3c0-4844-86cb-2ce964c6046b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:56.091250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0957337-c3c0-4844-86cb-2ce964c6046b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:56.093088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0957337-c3c0-4844-86cb-2ce964c6046b service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:56.107116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 838/1640] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:56.575559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:56.577036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:56.607488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462dd6e1-e714-414b-b19a-035bbd635af0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:56.646883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:56.648119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:56.648563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:56.651038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] PATH_INFO: `/v3/users/bf4a8e785f574be28733a0c457edc115` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:56.655995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4a8e785f574be28733a0c457edc115)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:56.665023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: WARNING py.warnings [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:57:56.665023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: warnings.warn(msg) Aug 24 06:57:56.665023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: Aug 24 06:57:56.672715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:57.138020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4a8e785f574be28733a0c457edc115'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:57.138809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4a8e785f574be28733a0c457edc115'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:57.309915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4a8e785f574be28733a0c457edc115'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:57.364478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4a8e785f574be28733a0c457edc115'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:57.373923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4a8e785f574be28733a0c457edc115'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:57.394535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 803/1641] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:57:56 2022] DELETE /identity/v3/users/bf4a8e785f574be28733a0c457edc115 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:57.398850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:57.399739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:57.400774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:57.413502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:57.447940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:57.449215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:57.546862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 839/1642] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:57.562147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:57.564404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:57.670482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805b2fbd-b6db-47b3-9566-1df6c4ebab4d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:57.678340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da090275-8e26-4db5-b22c-f87442b49962 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:57.679472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090275-8e26-4db5-b22c-f87442b49962 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:57.680202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090275-8e26-4db5-b22c-f87442b49962 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:57.680694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da090275-8e26-4db5-b22c-f87442b49962 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:57.688700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:57.690565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:57.696484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090275-8e26-4db5-b22c-f87442b49962 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:57.700089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da090275-8e26-4db5-b22c-f87442b49962 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:57.718654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa19f4f-00a6-43a0-b4a3-f93f97cae55d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:57.735340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 804/1643] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:57:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:57:57.747709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:57.748513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:57.748806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:57.749082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] PATH_INFO: `/v3/projects/9349d644a2c243d4bcf524e28904b44c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:57.750489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9349d644a2c243d4bcf524e28904b44c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:57.751607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: WARNING py.warnings [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 24 06:57:57.751607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: warnings.warn(msg) Aug 24 06:57:57.751607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: Aug 24 06:57:57.752844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:57.952303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9349d644a2c243d4bcf524e28904b44c', 'request_id': 'req-b1de9a72-e84d-4788-bcee-26ed52242e51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:57.979419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9349d644a2c243d4bcf524e28904b44c', 'request_id': 'req-b1de9a72-e84d-4788-bcee-26ed52242e51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:58.080126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9349d644a2c243d4bcf524e28904b44c', 'request_id': 'req-b1de9a72-e84d-4788-bcee-26ed52242e51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:58.148253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] The token cache is being invalidate because project 9349d644a2c243d4bcf524e28904b44c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:57:58.148587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:58.149963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-b1de9a72-e84d-4788-bcee-26ed52242e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:57:58.156152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 840/1644] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:57:57 2022] DELETE /identity/v3/projects/9349d644a2c243d4bcf524e28904b44c => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:58.161517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4bdd5-b567-4d5b-89c9-50937409d3d5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:58.161905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4bdd5-b567-4d5b-89c9-50937409d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:58.162362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c4bdd5-b567-4d5b-89c9-50937409d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:58.212089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-23c4bdd5-b567-4d5b-89c9-50937409d3d5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:58.217000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-23c4bdd5-b567-4d5b-89c9-50937409d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:58.258924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:58.352458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 805/1645] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:58.360705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5a18-2f90-444e-a4c4-db9a8f0b69c3 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:58.361426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5a18-2f90-444e-a4c4-db9a8f0b69c3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:58.361867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc5a18-2f90-444e-a4c4-db9a8f0b69c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:58.410793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3bdc5a18-2f90-444e-a4c4-db9a8f0b69c3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:58.412123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3bdc5a18-2f90-444e-a4c4-db9a8f0b69c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:58.432956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 841/1646] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:58.437270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4bdd5-b567-4d5b-89c9-50937409d3d5 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:58.452008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c4bdd5-b567-4d5b-89c9-50937409d3d5 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:58.477606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:58.477975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:58.478986 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:58.479276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:58.479966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:57:58.480281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:58.481920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:58.529775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 806/1647] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:57:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:57:58.535076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc5a18-2f90-444e-a4c4-db9a8f0b69c3 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:58.555982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc5a18-2f90-444e-a4c4-db9a8f0b69c3 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:58.565140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:58.566147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:58.566598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:58.567642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:58.568496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:58.571067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:58.730225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 842/1648] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:58 2022] POST /identity/v3/projects => generated 369 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:58.736762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:58.759039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca5d28-8121-47c0-8199-7fec5ee4d790 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:58.910157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:58.912317 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:58.913652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:58.914558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:58.917261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:58.925103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:59.060291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 807/1649] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:57:58 2022] POST /identity/v3/users => generated 285 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:57:59.064443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:59.082019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6527ccb-c453-4a96-8db1-0193735de34a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:59.107955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:59.118369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:59.120564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:59.125680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:59.126852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:59.131962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:59.150975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 843/1650] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:59.155866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:59.171574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf4c20-0fa8-4a77-90d2-4bb45886450a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:59.192066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f5a095-2093-4a7f-a525-246f2568805b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:59.192922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a095-2093-4a7f-a525-246f2568805b admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:59.193377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a095-2093-4a7f-a525-246f2568805b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:59.193795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f5a095-2093-4a7f-a525-246f2568805b admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:59.194661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a095-2093-4a7f-a525-246f2568805b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:59.196504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f5a095-2093-4a7f-a525-246f2568805b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:59.254025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 808/1651] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:57:59 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:57:59.258109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:59.275302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822038c-8258-4735-9508-6b24a53a5d94 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:59.281894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:59.286530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:59.286530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:59.286530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] PATH_INFO: `/v3/projects/9d21931cb0c54d71b8a6fc6aac141c3a/users/5cee0e5c3e4e4ae1bc2d53f228c06919/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:59.314817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d21931cb0c54d71b8a6fc6aac141c3a, user_id=5cee0e5c3e4e4ae1bc2d53f228c06919, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:59.321118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:57:59.452879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 844/1652] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:57:59 2022] PUT /identity/v3/projects/9d21931cb0c54d71b8a6fc6aac141c3a/users/5cee0e5c3e4e4ae1bc2d53f228c06919/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:57:59.465509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:59.465509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:59.465789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:59.532919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] MFA Rules not processed for user `5cee0e5c3e4e4ae1bc2d53f228c06919`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:57:59.534186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:59.652895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 809/1653] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:57:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:57:59.660288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:59.752576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:57:59.754267 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:57:59.757106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:57:59.902079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999240b-ac7b-4e7f-a826-ec01c057bb52 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:57:59.929448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:57:59.930445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:57:59.931074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:57:59.931573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:57:59.932448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:57:59.934790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:00.024063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c127789-cd69-427e-8646-2e8f5e50eb2d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:00.040091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:00.040091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.040091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.040091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] PATH_INFO: `/v3/projects/169e85d3dfde4cbcbd065effc3d76f67` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.042166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] RBAC: Authorizing `identity:delete_project(project_id=169e85d3dfde4cbcbd065effc3d76f67)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:00.044544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:00.165144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 845/1654] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:57:59 2022] POST /identity/v3/projects => generated 373 bytes in 508 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:00.170219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:00.310702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '169e85d3dfde4cbcbd065effc3d76f67', 'request_id': 'req-91d66251-5d99-4386-aeca-88296abad59b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:00.329392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '169e85d3dfde4cbcbd065effc3d76f67', 'request_id': 'req-91d66251-5d99-4386-aeca-88296abad59b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:00.345944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '169e85d3dfde4cbcbd065effc3d76f67', 'request_id': 'req-91d66251-5d99-4386-aeca-88296abad59b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:00.368848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2baf5d-ad06-4d33-bfac-303dc2deede1 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:00.488943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] The token cache is being invalidate because project 169e85d3dfde4cbcbd065effc3d76f67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:00.490042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:00.490968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-91d66251-5d99-4386-aeca-88296abad59b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:00.492966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 810/1655] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:57:59 2022] DELETE /identity/v3/projects/169e85d3dfde4cbcbd065effc3d76f67 => generated 0 bytes in 741 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:00.498611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad222ad-20ad-48bd-961b-375a989e0052 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.499027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad222ad-20ad-48bd-961b-375a989e0052 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.499313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad222ad-20ad-48bd-961b-375a989e0052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.553543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:00.554685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1ad222ad-20ad-48bd-961b-375a989e0052 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:00.555373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.555657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.555983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.557909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1ad222ad-20ad-48bd-961b-375a989e0052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:00.559573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:00.564263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:00.593129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 811/1656] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:00.597448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c796ff9-0be3-436b-9c7a-3360f24916e5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.597448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c796ff9-0be3-436b-9c7a-3360f24916e5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.597448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c796ff9-0be3-436b-9c7a-3360f24916e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.647374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-6c796ff9-0be3-436b-9c7a-3360f24916e5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:00.651763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6c796ff9-0be3-436b-9c7a-3360f24916e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:00.678874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 812/1657] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:00.680270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c796ff9-0be3-436b-9c7a-3360f24916e5 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:00.702077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c796ff9-0be3-436b-9c7a-3360f24916e5 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:00.732934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 846/1658] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:00 2022] POST /identity/v3/users => generated 293 bytes in 563 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:00.735166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:00.736982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:00.740342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:00.744183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:00.746365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.751594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.751594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.751594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:00.755097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:00.757015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:00.777675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade78d34-0f9b-4b6b-bd1b-072bea4a7a7e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:00.800371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:00.803231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 813/1659] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:58:00.803351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.803351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.803351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.807803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:00.808961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:00.811571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:00.836721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08fe84-7050-465d-a7c5-990c3d6e4879 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:00.845079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 847/1660] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:00.850442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:00.853589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:00.854432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.855860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.856300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.858636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:00.863720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:00.874936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6a1e0f-5afb-4bde-85c9-cabb68034de1 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:00.898452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:00.899209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:00.899499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:00.900314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] PATH_INFO: `/v3/projects/b582aadb8422433685798a0f8fb40cc6/users/837490bf814c4e46af2ca4060a78faf8/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:00.933560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b582aadb8422433685798a0f8fb40cc6, user_id=837490bf814c4e46af2ca4060a78faf8, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:00.936866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:00.985583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 814/1661] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:00 2022] POST /identity/v3/projects => generated 403 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:00.986504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:01.066214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 848/1662] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:00 2022] PUT /identity/v3/projects/b582aadb8422433685798a0f8fb40cc6/users/837490bf814c4e46af2ca4060a78faf8/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:01.067386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:01.130993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea658d4-e088-4a31-9f7d-0103c6d58c8a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:01.257762 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa78cd-9763-4457-8181-6bbf0799faa6 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:01.266607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:01.267449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.287087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:01.287087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.287347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.290951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.290951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.290951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:01.292554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:01.303043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.305175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:01.315127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:01.350114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 849/1663] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:01.360563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:01.392808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 815/1664] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:00 2022] POST /identity/v3/users => generated 302 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:01.393136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b3dab-41c1-4160-8536-6c84d493b1d1 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:01.398571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:01.408757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbb25ce-1e86-483d-a66e-1d700112276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:01.410210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb25ce-1e86-483d-a66e-1d700112276e admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.410505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb25ce-1e86-483d-a66e-1d700112276e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.411508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbb25ce-1e86-483d-a66e-1d700112276e admin admin] PATH_INFO: `/v3/projects/b582aadb8422433685798a0f8fb40cc6/users/837490bf814c4e46af2ca4060a78faf8/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.418443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1634b8-8c62-470f-aefc-e1a322ec232b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:01.437408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb25ce-1e86-483d-a66e-1d700112276e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b582aadb8422433685798a0f8fb40cc6, user_id=837490bf814c4e46af2ca4060a78faf8, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:01.449733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbb25ce-1e86-483d-a66e-1d700112276e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:01.452543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:01.452543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.452543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.452543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.453702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:01.455409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:01.499247 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 816/1665] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:01.500418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:01.502254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 850/1666] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:01 2022] PUT /identity/v3/projects/b582aadb8422433685798a0f8fb40cc6/users/837490bf814c4e46af2ca4060a78faf8/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:01.514521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.515104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.515526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.540085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0314f8-187b-4f48-9cfb-227658495827 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:01.641523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] MFA Rules not processed for user `837490bf814c4e46af2ca4060a78faf8`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:01.642818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:01.788700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:01.789975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.790461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.791704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.792533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:01.797285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:01.806589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 851/1667] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:01.807910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:01.819713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:01.822050 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 817/1668] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:01 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:01.830198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:01.858114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414ff75c-5f3b-482a-af2f-cec3ab1160a3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:01.864206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0f9f80-887c-42b8-92e9-49779e322b91 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:01.874494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:01.875555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:01.876227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.876621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.879525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:01.879525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:01.879525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] PATH_INFO: `/v3/users/274a8b1be49747a4862fb8e14de8d595` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.879998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] PATH_INFO: `/v3/projects/349d9308b08c47f9a2ddf32518ad6a76/users/7999e1a68d714564a37f166cb3f971cd/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:01.882918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] RBAC: Authorizing `identity:delete_user(user_id=274a8b1be49747a4862fb8e14de8d595)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:01.886060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:01.918025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] RBAC: Authorizing `identity:create_grant(project_id=349d9308b08c47f9a2ddf32518ad6a76, user_id=7999e1a68d714564a37f166cb3f971cd, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:01.937459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:02.064101 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 818/1669] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:01 2022] PUT /identity/v3/projects/349d9308b08c47f9a2ddf32518ad6a76/users/7999e1a68d714564a37f166cb3f971cd/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:02.077736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:02.088120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:02.189037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '274a8b1be49747a4862fb8e14de8d595'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:02.191722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '274a8b1be49747a4862fb8e14de8d595'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:02.218796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:02.271832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '274a8b1be49747a4862fb8e14de8d595'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:02.282135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '274a8b1be49747a4862fb8e14de8d595'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:02.325289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6b7bbb0c-e1f1-49eb-b06f-659ad0465b47 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '274a8b1be49747a4862fb8e14de8d595'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:02.347209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf7716-e1f4-44de-867e-cdf795a3f56c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:02.357630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713116f-fc01-47bf-ab6b-f8ec8ac85477 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:02.359023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713116f-fc01-47bf-ab6b-f8ec8ac85477 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:02.359483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713116f-fc01-47bf-ab6b-f8ec8ac85477 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:02.359810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713116f-fc01-47bf-ab6b-f8ec8ac85477 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:02.366479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3713116f-fc01-47bf-ab6b-f8ec8ac85477 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:02.376661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 852/1670] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:01 2022] DELETE /identity/v3/users/274a8b1be49747a4862fb8e14de8d595 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:02.376661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:02.376661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:02.376661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:02.422973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:02.482099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] MFA Rules not processed for user `7999e1a68d714564a37f166cb3f971cd`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:02.483795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:02.558302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713116f-fc01-47bf-ab6b-f8ec8ac85477 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:02.560438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713116f-fc01-47bf-ab6b-f8ec8ac85477 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:02.592160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 819/1671] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:02.596534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:02.599379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:02.600027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:02.686027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:02.688031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:02.752833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 853/1672] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:02 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:02.755830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:02.757618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:02.961917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23826db7-270a-4bc3-9e43-602aca3d3e1a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:02.971908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:02.974049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:02.974491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:02.977054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:02.978348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:02.996151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:03.015162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 820/1673] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:03.050148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:03.052200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:03.239499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 854/1674] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:02 2022] POST /identity/v3/projects => generated 401 bytes in 484 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:03.245802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:03.265371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3a5de-b003-4adc-ba89-4ab9cca963e0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:03.397326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:03.397967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:03.398252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:03.398531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:03.440557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281aae8c-c7cd-4bef-a54c-67bccd83821f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:03.461089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:03.463465 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:03.465413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:03.465727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:03.468111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:03.476745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:03.620461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 855/1675] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:03 2022] POST /identity/v3/users => generated 307 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:03.624523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:03.642459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:03.644224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:03.659718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54c41a1-d45c-454b-a7aa-49a9aa0d0aec admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:03.673571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:03.674563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:03.676061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:03.677298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 821/1676] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:03.678999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:03.680713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:03.687088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:03.707088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 856/1677] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:03.713966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:03.724200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4911b-8e67-4fc3-b3a7-fa89afdee378 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:03.736078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:03.736995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:03.737508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:03.738022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] PATH_INFO: `/v3/projects/8caa7fe01f244fe0997fa8b939a6bfd2/users/9d664b872cb6468e9eb148afb153c968/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:03.793185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa7fe01f244fe0997fa8b939a6bfd2, user_id=9d664b872cb6468e9eb148afb153c968, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:03.801943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:03.815158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:03.907985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 822/1678] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:03 2022] PUT /identity/v3/projects/8caa7fe01f244fe0997fa8b939a6bfd2/users/9d664b872cb6468e9eb148afb153c968/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:03.912849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:03.931607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0560f120-8fe2-4e73-befa-bbdba65b2915 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:04.081707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8647fa19-adef-4460-8e14-76e59286827d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:04.082850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647fa19-adef-4460-8e14-76e59286827d admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:04.083343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647fa19-adef-4460-8e14-76e59286827d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:04.083770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8647fa19-adef-4460-8e14-76e59286827d admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:04.084821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647fa19-adef-4460-8e14-76e59286827d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:04.087880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8647fa19-adef-4460-8e14-76e59286827d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:04.113016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 857/1679] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:03 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:04.117230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:04.132998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef0b7-19b0-4bab-a913-32bdc32ba7ec admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:04.150201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:04.152630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:04.153115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:04.154855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] PATH_INFO: `/v3/projects/8caa7fe01f244fe0997fa8b939a6bfd2/users/9d664b872cb6468e9eb148afb153c968/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:04.166200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8caa7fe01f244fe0997fa8b939a6bfd2, user_id=9d664b872cb6468e9eb148afb153c968, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:04.169481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:04.201950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 823/1680] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:04 2022] PUT /identity/v3/projects/8caa7fe01f244fe0997fa8b939a6bfd2/users/9d664b872cb6468e9eb148afb153c968/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:04.213466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:04.215013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:04.215291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:04.271526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] MFA Rules not processed for user `9d664b872cb6468e9eb148afb153c968`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:04.276590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:04.317157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:04.319408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:04.506676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 858/1681] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:04 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:04.531727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630a6657-96eb-47fc-a7a0-5bef8bbdecd1 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:04.575858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:04.580174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:04.580666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:04.581170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] PATH_INFO: `/v3/users/5cee0e5c3e4e4ae1bc2d53f228c06919` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:04.583287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cee0e5c3e4e4ae1bc2d53f228c06919)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:04.590891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:04.614199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:04.617628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:04.734934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:04.779653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a5590a-4ad8-480b-b774-cc6f6081f213 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:04.791873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b252fd-a104-436d-b374-5183732297a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:04.794004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b252fd-a104-436d-b374-5183732297a3 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:04.794669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b252fd-a104-436d-b374-5183732297a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:04.794971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b252fd-a104-436d-b374-5183732297a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:04.807265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b252fd-a104-436d-b374-5183732297a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:04.808901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b252fd-a104-436d-b374-5183732297a3 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:04.826676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 859/1682] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:04 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:04.828215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:04.828497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:04.828768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:04.860502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] MFA Rules not processed for user `024eb38f66684644b1d0b38b3f297ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:04.861739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.029746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cee0e5c3e4e4ae1bc2d53f228c06919'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.032051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cee0e5c3e4e4ae1bc2d53f228c06919'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.120418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 860/1683] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:04 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:05.120418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:05.120418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.139220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cee0e5c3e4e4ae1bc2d53f228c06919'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.151602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc38fe9-1108-4012-9e12-4e677e02a615 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:05.159697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:05.160782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:05.161001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:05.161277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] PATH_INFO: `/v3/projects/9179f3fa1f09430cb8b17d8746615ad9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:05.162331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cee0e5c3e4e4ae1bc2d53f228c06919'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.162593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9179f3fa1f09430cb8b17d8746615ad9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:05.174143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cee0e5c3e4e4ae1bc2d53f228c06919'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.174455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:05.189019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 824/1684] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:04 2022] DELETE /identity/v3/users/5cee0e5c3e4e4ae1bc2d53f228c06919 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:05.190469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:05.192957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.315802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9179f3fa1f09430cb8b17d8746615ad9', 'request_id': 'req-49205749-50aa-4782-be11-86892a6843ff'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.318571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fbc8fc-60dc-45ae-b6d3-9f5c9d99d8f4 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:05.329395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9179f3fa1f09430cb8b17d8746615ad9', 'request_id': 'req-49205749-50aa-4782-be11-86892a6843ff'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.424487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:05.425593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:05.426018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:05.426444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] PATH_INFO: `/v3/users/7999e1a68d714564a37f166cb3f971cd` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:05.429143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7999e1a68d714564a37f166cb3f971cd)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:05.432272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:05.443251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9179f3fa1f09430cb8b17d8746615ad9', 'request_id': 'req-49205749-50aa-4782-be11-86892a6843ff'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.460881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] The token cache is being invalidate because project 9179f3fa1f09430cb8b17d8746615ad9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:05.461638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.463225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.464919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 861/1685] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:05 2022] DELETE /identity/v3/projects/9179f3fa1f09430cb8b17d8746615ad9 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:05.466180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:05.467722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.552700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49205749-50aa-4782-be11-86892a6843ff admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:05.559102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3c769-8cf4-4d6f-8619-b6211f5e8e4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:05.559774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c769-8cf4-4d6f-8619-b6211f5e8e4b service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:05.560511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c769-8cf4-4d6f-8619-b6211f5e8e4b service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:05.560511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c769-8cf4-4d6f-8619-b6211f5e8e4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:05.562884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-49f3c769-8cf4-4d6f-8619-b6211f5e8e4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.653205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3c769-8cf4-4d6f-8619-b6211f5e8e4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:05.654974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3c769-8cf4-4d6f-8619-b6211f5e8e4b service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:05.672869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 862/1686] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:05 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:05.672869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30538-ad28-4827-ac27-6007ef90db3a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:05.672869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30538-ad28-4827-ac27-6007ef90db3a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:05.672869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e30538-ad28-4827-ac27-6007ef90db3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:05.673685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7999e1a68d714564a37f166cb3f971cd'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.673685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7999e1a68d714564a37f166cb3f971cd'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.691310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-14e30538-ad28-4827-ac27-6007ef90db3a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:05.693021 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-14e30538-ad28-4827-ac27-6007ef90db3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.712776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 863/1687] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:05.715694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:05.715694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:05.715694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:05.757171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:05.759977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7999e1a68d714564a37f166cb3f971cd'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.789761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7999e1a68d714564a37f166cb3f971cd'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.796322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] MFA Rules not processed for user `9e77780ae7d749f19d6840f69626b236`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:05.797591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.812007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-705ed55e-b65a-4e2d-b8a5-beb72672424a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7999e1a68d714564a37f166cb3f971cd'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:05.828887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 825/1688] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:05 2022] DELETE /identity/v3/users/7999e1a68d714564a37f166cb3f971cd => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:05.833040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257a5b-9bce-43a0-87e9-c45e338f029c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:05.837382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257a5b-9bce-43a0-87e9-c45e338f029c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:05.837894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90257a5b-9bce-43a0-87e9-c45e338f029c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:05.891800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-90257a5b-9bce-43a0-87e9-c45e338f029c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:05.897235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-90257a5b-9bce-43a0-87e9-c45e338f029c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:05.990988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 864/1689] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:05.991592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:05.996429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:06.002715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.070270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 826/1690] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:06.078847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.079408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.079704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.126062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:06.129478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.136763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d10cf5-ba7e-4de5-801e-065dc0353b46 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:06.141935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 827/1691] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:06.142916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:06.144490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.164679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aadd35-e95b-418a-864d-8ca9b129c095 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:06.175810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:06.176488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.176771 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.177042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] PATH_INFO: `/v3/users/9865106c152149e48033ef8f78467e1b` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.183551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9865106c152149e48033ef8f78467e1b)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:06.191603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:06.253377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34108a-ee96-450d-aee3-9ce3df31bca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:06.255395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34108a-ee96-450d-aee3-9ce3df31bca0 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.257186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34108a-ee96-450d-aee3-9ce3df31bca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.257186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34108a-ee96-450d-aee3-9ce3df31bca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.259452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0f34108a-ee96-450d-aee3-9ce3df31bca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.285952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34108a-ee96-450d-aee3-9ce3df31bca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:06.288397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f34108a-ee96-450d-aee3-9ce3df31bca0 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:06.307778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 865/1692] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:06.309222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf129ed-6c5a-4f7c-a599-c84f1d036051 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.309571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf129ed-6c5a-4f7c-a599-c84f1d036051 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.310101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf129ed-6c5a-4f7c-a599-c84f1d036051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.341534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-baf129ed-6c5a-4f7c-a599-c84f1d036051 None None] MFA Rules not processed for user `9e77780ae7d749f19d6840f69626b236`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:06.343474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-baf129ed-6c5a-4f7c-a599-c84f1d036051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.421154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:06.446369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9865106c152149e48033ef8f78467e1b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:06.446550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9865106c152149e48033ef8f78467e1b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:06.475049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 866/1693] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:06.480595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.480941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.481224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.513266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:06.514555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.532029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 867/1694] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:06.536553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:06.538181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.551430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd429c4c-f42a-4704-aedf-89e3da98f983 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:06.556012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:06.556672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.556959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.557212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.567717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9865106c152149e48033ef8f78467e1b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:06.571876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:06.578006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:06.587573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9865106c152149e48033ef8f78467e1b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:06.596561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3cc6e8b0-25f2-4c68-b767-3ea8e4d6cc50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9865106c152149e48033ef8f78467e1b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:06.601585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 868/1695] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:06.603170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:06.604633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.607807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 828/1696] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:06 2022] DELETE /identity/v3/users/9865106c152149e48033ef8f78467e1b => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:06.609271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.609712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.610188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.623613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d12f50c-eec5-4f46-a906-75b7069a947c service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:06.677179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] MFA Rules not processed for user `6a91e857dd3b4c1f9355b757cadd6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:06.677179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.763135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:06.763803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.764116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.764695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] PATH_INFO: `/v3/users/ac96056339554c41b4f42af19770191c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.767517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac96056339554c41b4f42af19770191c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:06.769750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:06.821200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 829/1697] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:06.822257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:06.823748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:06.962298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935da511-c899-4bbc-91d4-e1d66543739e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:06.969866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:06.971108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:06.971543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:06.971968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:06.974124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.062069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac96056339554c41b4f42af19770191c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.065156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac96056339554c41b4f42af19770191c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.104936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:07.107336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:07.120042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 830/1698] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:06 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:07.120975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:07.122829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.127226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac96056339554c41b4f42af19770191c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.138262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac96056339554c41b4f42af19770191c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.164434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62183ff-147a-48bb-9dac-501794bc52ec service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:07.167108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ae5347df-f184-4791-a834-6e4eddd2dc15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac96056339554c41b4f42af19770191c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.177388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5ac76-5cab-46ac-843d-df41b4997b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:07.180246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ac76-5cab-46ac-843d-df41b4997b89 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:07.180538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ac76-5cab-46ac-843d-df41b4997b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:07.184258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5ac76-5cab-46ac-843d-df41b4997b89 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:07.185413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5ac76-5cab-46ac-843d-df41b4997b89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:07.185783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 869/1699] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:06 2022] DELETE /identity/v3/users/ac96056339554c41b4f42af19770191c => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:07.190312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5ac76-5cab-46ac-843d-df41b4997b89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:07.190758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8c89-c6ea-49d8-8fee-e11b4db392b9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:07.193942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8c89-c6ea-49d8-8fee-e11b4db392b9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:07.194396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64f8c89-c6ea-49d8-8fee-e11b4db392b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:07.207726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5ac76-5cab-46ac-843d-df41b4997b89 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:07.219001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:07.230717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 831/1700] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:07.232125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:07.232458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:07.232746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:07.244525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f64f8c89-c6ea-49d8-8fee-e11b4db392b9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:07.247333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f64f8c89-c6ea-49d8-8fee-e11b4db392b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.276198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] MFA Rules not processed for user `6a91e857dd3b4c1f9355b757cadd6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:07.280908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.420842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 832/1701] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:07 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:07.421941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:07.424776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.452061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 870/1702] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:07.454058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:07.463299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:07.465818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:07.530609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:07.536428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.565499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 871/1703] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:07.572103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:07.573644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.583943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921d8e25-d02e-4c7e-b8e5-de2f8ea90fd1 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:07.591891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aca184a-0b99-4d27-b5f3-2f827ac7e4ea None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:07.595848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:07.597227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:07.603955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:07.603955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] PATH_INFO: `/v3/projects/9d21931cb0c54d71b8a6fc6aac141c3a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:07.603955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d21931cb0c54d71b8a6fc6aac141c3a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:07.604517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:07.605498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:07.606061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:07.606346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:07.607425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:07.610295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:07.612407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:07.631700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:07.725159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 872/1704] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:07 2022] POST /identity/v3/projects => generated 381 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:07.726601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:07.730736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.782941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d21931cb0c54d71b8a6fc6aac141c3a', 'request_id': 'req-80e90bf8-e191-48c3-b651-e348b7f6dd55'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.794723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d21931cb0c54d71b8a6fc6aac141c3a', 'request_id': 'req-80e90bf8-e191-48c3-b651-e348b7f6dd55'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.808135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d21931cb0c54d71b8a6fc6aac141c3a', 'request_id': 'req-80e90bf8-e191-48c3-b651-e348b7f6dd55'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.902696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3cc3aa-a45a-468e-9a2d-4972e6a80515 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:07.929108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] The token cache is being invalidate because project 9d21931cb0c54d71b8a6fc6aac141c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:07.929721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.930700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:07.932726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 833/1705] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:07 2022] DELETE /identity/v3/projects/9d21931cb0c54d71b8a6fc6aac141c3a => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:07.935930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:07.938239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:07.999250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:07.999990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.000293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.000553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.002622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.005571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e90bf8-e191-48c3-b651-e348b7f6dd55 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:08.011976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:08.012608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.012906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.013155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.015293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.068137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.069656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:08.081094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 873/1706] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:08.081964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:08.083511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.111893 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:08.121089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.122966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:08.153972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 834/1707] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:08.156032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:08.165344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342c2dee-1c27-418e-a346-34ac0f473915 service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:08.171867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:08.172668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.172964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.173246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] PATH_INFO: `/v3/projects/349d9308b08c47f9a2ddf32518ad6a76` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.174744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=349d9308b08c47f9a2ddf32518ad6a76)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.176897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:08.184231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9539a4d0-534d-4646-82a1-6898579a677d service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:08.207600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:08.208425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.214445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.214445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.214445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.245641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.248755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:08.277603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 835/1708] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:08.278781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:08.280570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.302006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dda8cb-d6c2-4a93-b766-78fcff38cfb6 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:08.310555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:08.311435 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.311905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.319200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.331461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.335070 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:08.353660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '349d9308b08c47f9a2ddf32518ad6a76', 'request_id': 'req-5973ec90-9f0a-4a95-996d-026da47ea3e3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:08.369479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '349d9308b08c47f9a2ddf32518ad6a76', 'request_id': 'req-5973ec90-9f0a-4a95-996d-026da47ea3e3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:08.516870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '349d9308b08c47f9a2ddf32518ad6a76', 'request_id': 'req-5973ec90-9f0a-4a95-996d-026da47ea3e3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:08.529480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 836/1709] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:08 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:08.530198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:08.540157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.552028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] The token cache is being invalidate because project 349d9308b08c47f9a2ddf32518ad6a76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:08.552028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:08.554858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-5973ec90-9f0a-4a95-996d-026da47ea3e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:08.563872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 874/1710] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:08 2022] DELETE /identity/v3/projects/349d9308b08c47f9a2ddf32518ad6a76 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:08.565294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff222e-dab2-4c7e-80c3-60c4a506bede None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.565591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff222e-dab2-4c7e-80c3-60c4a506bede None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.565871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfff222e-dab2-4c7e-80c3-60c4a506bede None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.569703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 875/1711] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 06:58:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:58:08.570654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff222e-dab2-4c7e-80c3-60c4a506bede None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:08.581801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bfff222e-dab2-4c7e-80c3-60c4a506bede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.584840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0291314e-832a-4d0e-bcbb-4b6f669bc99a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:08.725564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:08.725564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.725564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.725564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] PATH_INFO: `/v3/users/837490bf814c4e46af2ca4060a78faf8` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.725948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] RBAC: Authorizing `identity:delete_user(user_id=837490bf814c4e46af2ca4060a78faf8)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.725948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:08.761547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfff222e-dab2-4c7e-80c3-60c4a506bede None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:08.771813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:08.772450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.772732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.773010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.773744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.779123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:08.800280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 876/1712] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:08 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:08.800280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:08.802620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:08.820565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e72033-871f-404a-8fcd-482ddc9990dc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:08.826929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:08.827603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:08.827873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:08.828210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] PATH_INFO: `/v3/users/9d664b872cb6468e9eb148afb153c968` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:08.829374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d664b872cb6468e9eb148afb153c968)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:08.832698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:09.000997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '837490bf814c4e46af2ca4060a78faf8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.001895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '837490bf814c4e46af2ca4060a78faf8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.063667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d664b872cb6468e9eb148afb153c968'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.071307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d664b872cb6468e9eb148afb153c968'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.073009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '837490bf814c4e46af2ca4060a78faf8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.096598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '837490bf814c4e46af2ca4060a78faf8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.110136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3b842d85-9d8b-4e6f-8bde-9e9b5458449f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '837490bf814c4e46af2ca4060a78faf8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.121291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 837/1713] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:08 2022] DELETE /identity/v3/users/837490bf814c4e46af2ca4060a78faf8 => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:09.123231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1d45-a5c5-4eb2-b49d-e0bfa4552273 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.123755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1d45-a5c5-4eb2-b49d-e0bfa4552273 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.124284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779b1d45-a5c5-4eb2-b49d-e0bfa4552273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.182968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d664b872cb6468e9eb148afb153c968'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.185280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-779b1d45-a5c5-4eb2-b49d-e0bfa4552273 None None] MFA Rules not processed for user `60b49283ccd0414389601e5e6f339c45`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:09.187781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-779b1d45-a5c5-4eb2-b49d-e0bfa4552273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:09.193025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d664b872cb6468e9eb148afb153c968'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.233274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-612c62a0-4ea9-4f24-8982-7547e6f13b9c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d664b872cb6468e9eb148afb153c968'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:09.249635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 877/1714] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:08 2022] DELETE /identity/v3/users/9d664b872cb6468e9eb148afb153c968 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:09.252747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554836ff-2cb3-474b-857a-820f23b9487b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.252747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554836ff-2cb3-474b-857a-820f23b9487b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.252747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554836ff-2cb3-474b-857a-820f23b9487b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.259947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 878/1715] 10.222.0.59 () {54 vars in 912 bytes} [Wed Aug 24 06:58:09 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:58:09.260722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554836ff-2cb3-474b-857a-820f23b9487b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:09.262149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 838/1716] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:58:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:09.265528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-554836ff-2cb3-474b-857a-820f23b9487b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:09.274758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df0b02-b645-4c6a-be1d-0aaa6cb13d6f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.275397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df0b02-b645-4c6a-be1d-0aaa6cb13d6f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.276284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3df0b02-b645-4c6a-be1d-0aaa6cb13d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.312699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b3df0b02-b645-4c6a-be1d-0aaa6cb13d6f None None] MFA Rules not processed for user `60b49283ccd0414389601e5e6f339c45`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:09.315391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b3df0b02-b645-4c6a-be1d-0aaa6cb13d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:09.439182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 839/1717] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:58:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:09.453061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554836ff-2cb3-474b-857a-820f23b9487b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:09.472097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:09.475129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:09.476382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.476874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.477426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.478491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:09.480785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:09.502695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 879/1718] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:09 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:09.503977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df0b02-b645-4c6a-be1d-0aaa6cb13d6f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:09.542564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:09.548690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:09.550300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3df0b02-b645-4c6a-be1d-0aaa6cb13d6f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:09.581731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:09.582709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.584764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:09.585354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.585845 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] PATH_INFO: `/v3/projects/8adfc9fa3cd84a7c92bd3daca1fd5900/users/d64fc40dd2b845b2a4cc34fa9a36347e/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.589338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838a418c-362e-4acd-b625-bf15e81a88c0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:09.595165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:09.595883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.596170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.597740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.627712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:09.632019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8adfc9fa3cd84a7c92bd3daca1fd5900, user_id=d64fc40dd2b845b2a4cc34fa9a36347e, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:09.632989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:09.641392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:09.653166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 880/1719] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:09.655524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:09.665593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d132c-6abb-48a1-8cd7-e509b9be03d1 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:09.674363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:09.674363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.674363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.674363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.692532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:09.704316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:09.734446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 881/1720] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:09.735412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:09.738229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:09.756631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 840/1721] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:09 2022] PUT /identity/v3/projects/8adfc9fa3cd84a7c92bd3daca1fd5900/users/d64fc40dd2b845b2a4cc34fa9a36347e/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:09.758201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:09.767041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b3489-bb11-4e07-9c8b-2f2e4d38fb68 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:09.777071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:09.824166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:09.914434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:09.915162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.915451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.915730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] PATH_INFO: `/v3/projects/ab46cad9935f4c6f8300388306c58573` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:09.918551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab46cad9935f4c6f8300388306c58573)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:09.920706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:09.973814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd582ae-bcd5-40a9-8d77-43d0bfe1c05c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:09.996506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:09.997625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:09.997625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:09.997801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] PATH_INFO: `/v3/projects/ac1d7af4d7214d0c88a3d06e2a9e9117` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:10.007675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1d7af4d7214d0c88a3d06e2a9e9117)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:10.010132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:10.160051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab46cad9935f4c6f8300388306c58573', 'request_id': 'req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.170504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab46cad9935f4c6f8300388306c58573', 'request_id': 'req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.182291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1d7af4d7214d0c88a3d06e2a9e9117', 'request_id': 'req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.197688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1d7af4d7214d0c88a3d06e2a9e9117', 'request_id': 'req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.222651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1d7af4d7214d0c88a3d06e2a9e9117', 'request_id': 'req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.237011 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab46cad9935f4c6f8300388306c58573', 'request_id': 'req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.255127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] The token cache is being invalidate because project ab46cad9935f4c6f8300388306c58573 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:10.255233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.255921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-89ec42f6-9bc4-4945-aab1-d7ae64aa9eea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.261640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 882/1722] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:09 2022] DELETE /identity/v3/projects/ab46cad9935f4c6f8300388306c58573 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:10.265259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:10.265560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:10.265900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:10.338482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] MFA Rules not processed for user `d64fc40dd2b845b2a4cc34fa9a36347e`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:10.339789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:10.369345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] The token cache is being invalidate because project ac1d7af4d7214d0c88a3d06e2a9e9117 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:10.369668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.370475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9bcdc8fd-d46a-4fc7-bf51-57ff28c31ead admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:10.372502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 841/1723] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:09 2022] DELETE /identity/v3/projects/ac1d7af4d7214d0c88a3d06e2a9e9117 => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:10.373876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:10.374168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:10.374444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:10.453141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:10.456504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:10.546538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 883/1724] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:10 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:10.547753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:10.553499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:10.660671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 842/1725] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:10.668404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:10.668404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:10.705868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc01cb8-6df2-4c98-b52e-bd095a73402f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:10.723779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a10e1d-4f8e-49c8-88cc-6f21acc91fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:10.724592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10e1d-4f8e-49c8-88cc-6f21acc91fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:10.724950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10e1d-4f8e-49c8-88cc-6f21acc91fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:10.725259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a10e1d-4f8e-49c8-88cc-6f21acc91fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:10.725795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10e1d-4f8e-49c8-88cc-6f21acc91fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:10.727827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a10e1d-4f8e-49c8-88cc-6f21acc91fd8 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:10.782305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497761-4ad7-4d28-b563-03905f9f760b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:10.798204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:10.799070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:10.799498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:10.801085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] PATH_INFO: `/v3/users/e59198b41dd2488584fbf04b59dc8237` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:10.808934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e59198b41dd2488584fbf04b59dc8237)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:10.813871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:10.927588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 843/1726] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:10 2022] POST /identity/v3/projects => generated 383 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:10.928102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:10.929059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:10.929606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.002115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:11.006273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.117508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 844/1727] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:11.118642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:11.126385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.138147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e59198b41dd2488584fbf04b59dc8237'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.138433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e59198b41dd2488584fbf04b59dc8237'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.140219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411be699-5d8d-40d3-9938-f4061c60b616 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:11.146028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:11.146682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:11.147001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:11.147282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] PATH_INFO: `/v3/projects/b582aadb8422433685798a0f8fb40cc6` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.148436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b582aadb8422433685798a0f8fb40cc6)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:11.151226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:11.258925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e59198b41dd2488584fbf04b59dc8237'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.269205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e59198b41dd2488584fbf04b59dc8237'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.283348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e59198b41dd2488584fbf04b59dc8237'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.290999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 884/1728] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:10 2022] DELETE /identity/v3/users/e59198b41dd2488584fbf04b59dc8237 => generated 0 bytes in 744 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:11.295830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:11.296046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b582aadb8422433685798a0f8fb40cc6', 'request_id': 'req-6cbd0031-9a95-4ca8-9a13-f800c237a19b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.297759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.317003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b582aadb8422433685798a0f8fb40cc6', 'request_id': 'req-6cbd0031-9a95-4ca8-9a13-f800c237a19b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.329795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b582aadb8422433685798a0f8fb40cc6', 'request_id': 'req-6cbd0031-9a95-4ca8-9a13-f800c237a19b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.407545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3355ac9-cc01-47e9-80e7-7bd1d6ff9fb2 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:11.415447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:11.416958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:11.417343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:11.417629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] PATH_INFO: `/v3/projects/8caa7fe01f244fe0997fa8b939a6bfd2` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.419513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8caa7fe01f244fe0997fa8b939a6bfd2)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:11.421610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:11.451231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] The token cache is being invalidate because project b582aadb8422433685798a0f8fb40cc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:11.451231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.451231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6cbd0031-9a95-4ca8-9a13-f800c237a19b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.451231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 845/1729] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:11 2022] DELETE /identity/v3/projects/b582aadb8422433685798a0f8fb40cc6 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:11.451231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb8106-f120-44d9-b985-8783e6cb0c9c None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:11.451571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb8106-f120-44d9-b985-8783e6cb0c9c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:11.451571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb8106-f120-44d9-b985-8783e6cb0c9c None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.451951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 846/1730] 10.222.0.59 () {54 vars in 961 bytes} [Wed Aug 24 06:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:58:11.452561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb8106-f120-44d9-b985-8783e6cb0c9c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:11.456655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-68cb8106-f120-44d9-b985-8783e6cb0c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.485235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb8106-f120-44d9-b985-8783e6cb0c9c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:11.490489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdce1c9b-96a5-405e-a1d9-da8f90acfaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:11.491177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1c9b-96a5-405e-a1d9-da8f90acfaa5 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:11.491463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1c9b-96a5-405e-a1d9-da8f90acfaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:11.491742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdce1c9b-96a5-405e-a1d9-da8f90acfaa5 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.492399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce1c9b-96a5-405e-a1d9-da8f90acfaa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:11.496019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdce1c9b-96a5-405e-a1d9-da8f90acfaa5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:11.608484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 847/1731] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:11 2022] POST /identity/v3/users => generated 298 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:11.620468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8caa7fe01f244fe0997fa8b939a6bfd2', 'request_id': 'req-907cd0f6-8881-4acf-b2ab-0cec0b064295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.623311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6230-1308-4a1c-bc1c-16e22332b3d9 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:11.625604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6230-1308-4a1c-bc1c-16e22332b3d9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:11.626490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf6230-1308-4a1c-bc1c-16e22332b3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.639104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8caa7fe01f244fe0997fa8b939a6bfd2', 'request_id': 'req-907cd0f6-8881-4acf-b2ab-0cec0b064295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.660275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:11.665349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-71cf6230-1308-4a1c-bc1c-16e22332b3d9 None None] MFA Rules not processed for user `024eb38f66684644b1d0b38b3f297ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:11.666657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-71cf6230-1308-4a1c-bc1c-16e22332b3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.727913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8caa7fe01f244fe0997fa8b939a6bfd2', 'request_id': 'req-907cd0f6-8881-4acf-b2ab-0cec0b064295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.730699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:11.747384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] The token cache is being invalidate because project 8caa7fe01f244fe0997fa8b939a6bfd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:11.751366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.752409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:11.757376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 885/1732] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:11 2022] DELETE /identity/v3/projects/8caa7fe01f244fe0997fa8b939a6bfd2 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:11.757376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:11.757661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 848/1733] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:11.757750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.758676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:11.759205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:11.765691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.791407 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] MFA Rules not processed for user `6a91e857dd3b4c1f9355b757cadd6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:11.793223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.888637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 849/1734] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:11.889869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:11.891626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:11.958527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907cd0f6-8881-4acf-b2ab-0cec0b064295 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:11.966139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:11.971588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a55cc3-46de-4155-928b-4a7ee29104b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:11.973105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a55cc3-46de-4155-928b-4a7ee29104b7 service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:11.973536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a55cc3-46de-4155-928b-4a7ee29104b7 service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:11.973953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a55cc3-46de-4155-928b-4a7ee29104b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:11.976143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-14a55cc3-46de-4155-928b-4a7ee29104b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.003868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a55cc3-46de-4155-928b-4a7ee29104b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.005611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a55cc3-46de-4155-928b-4a7ee29104b7 service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.020651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 886/1735] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:12.038255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.041305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.041599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.043015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bba071-90a7-41e9-817d-d1204ff6104f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.054862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c716d1-753a-4c06-ac11-6ccd73e0e260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.055955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c716d1-753a-4c06-ac11-6ccd73e0e260 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.056417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c716d1-753a-4c06-ac11-6ccd73e0e260 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.058894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c716d1-753a-4c06-ac11-6ccd73e0e260 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.059773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c716d1-753a-4c06-ac11-6ccd73e0e260 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:12.061129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c716d1-753a-4c06-ac11-6ccd73e0e260 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.065929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c716d1-753a-4c06-ac11-6ccd73e0e260 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.087315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:12.089411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.092930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 850/1736] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:12.094509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa2ea3-61f5-4802-adc7-59f9833ae921 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.094930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa2ea3-61f5-4802-adc7-59f9833ae921 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.095388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faa2ea3-61f5-4802-adc7-59f9833ae921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.110062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 887/1737] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:12.110885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.119715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.123088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1faa2ea3-61f5-4802-adc7-59f9833ae921 None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:12.124919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1faa2ea3-61f5-4802-adc7-59f9833ae921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.133507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a261c84f-7dca-4935-ab9a-af8aa2abefc5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.139210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.140132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.140132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.144262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.144351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 851/1738] 10.222.0.59 () {58 vars in 1058 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:12.144437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.144437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.147718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917562-0de7-469d-9124-43eee702baf8 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.148115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917562-0de7-469d-9124-43eee702baf8 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.148471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35917562-0de7-469d-9124-43eee702baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.161527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 888/1739] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:12.161527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.175988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ab73c6-ddc1-40e6-a5de-7b993571c6f3 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.178399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-35917562-0de7-469d-9124-43eee702baf8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:12.180054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-35917562-0de7-469d-9124-43eee702baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.183453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.183453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.183453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.183453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.184404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.186493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.190386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 852/1740] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:12.192244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872440-0d98-4317-a99b-e2a5f633a1df None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.192592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872440-0d98-4317-a99b-e2a5f633a1df None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.192966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e872440-0d98-4317-a99b-e2a5f633a1df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.220770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0e872440-0d98-4317-a99b-e2a5f633a1df None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:12.222226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0e872440-0d98-4317-a99b-e2a5f633a1df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.231253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 853/1741] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:12.235195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872440-0d98-4317-a99b-e2a5f633a1df None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.249224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e872440-0d98-4317-a99b-e2a5f633a1df None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.256623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.257330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.257691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.258579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.270610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.272355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.285201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 854/1742] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:12.286176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.297455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e53022-abb5-4aad-a73f-9ead41d4b53f service placement] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.302823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff025c4-936d-4d2a-9cfd-6d63f269008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.303627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff025c4-936d-4d2a-9cfd-6d63f269008a admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.304013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff025c4-936d-4d2a-9cfd-6d63f269008a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.304397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff025c4-936d-4d2a-9cfd-6d63f269008a admin admin] PATH_INFO: `/v3/projects/496a0de63a20493ca9819cce822ab843/users/ac2050d040f24e8eaea13e3d4a4afbc3/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.310963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 889/1743] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/projects => generated 363 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:12.313105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.318174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.328045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff025c4-936d-4d2a-9cfd-6d63f269008a admin admin] RBAC: Authorizing `identity:create_grant(project_id=496a0de63a20493ca9819cce822ab843, user_id=ac2050d040f24e8eaea13e3d4a4afbc3, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.330887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff025c4-936d-4d2a-9cfd-6d63f269008a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.417350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1da8f53-e412-436f-9f0a-753998e2b273 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.429658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.431256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.431777 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.432257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] PATH_INFO: `/v3/projects/d0ed67036b884875ba45a72ec2f6bba6` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.442675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:12.444171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ed67036b884875ba45a72ec2f6bba6)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.444792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 855/1744] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:12 2022] PUT /identity/v3/projects/496a0de63a20493ca9819cce822ab843/users/ac2050d040f24e8eaea13e3d4a4afbc3/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:12.446671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3377e-89f3-49cc-955c-31074381ae1e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.447581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3377e-89f3-49cc-955c-31074381ae1e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.450108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d3377e-89f3-49cc-955c-31074381ae1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.451454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.501406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-33d3377e-89f3-49cc-955c-31074381ae1e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:12.502718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-33d3377e-89f3-49cc-955c-31074381ae1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.577135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 856/1745] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:12.578228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3377e-89f3-49cc-955c-31074381ae1e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.599506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d3377e-89f3-49cc-955c-31074381ae1e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.607302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ed67036b884875ba45a72ec2f6bba6', 'request_id': 'req-ea74c06a-79af-45fc-8b7c-57a817aaab90'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:12.613559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ed67036b884875ba45a72ec2f6bba6', 'request_id': 'req-ea74c06a-79af-45fc-8b7c-57a817aaab90'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:12.677755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.678391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.678684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.679002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.679815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:12.680670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.682425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.700398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 857/1746] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:12.701421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.709651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ed67036b884875ba45a72ec2f6bba6', 'request_id': 'req-ea74c06a-79af-45fc-8b7c-57a817aaab90'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:12.716160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1daef-7a7c-4c9b-a33b-a7fef690b07b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.726465 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] The token cache is being invalidate because project d0ed67036b884875ba45a72ec2f6bba6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:12.727694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:12.730083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe2887-0ed0-49a9-a4e9-3e93823c993e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.731026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe2887-0ed0-49a9-a4e9-3e93823c993e admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.731178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe2887-0ed0-49a9-a4e9-3e93823c993e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.731801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:12.732231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe2887-0ed0-49a9-a4e9-3e93823c993e admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.732918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe2887-0ed0-49a9-a4e9-3e93823c993e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.735405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 890/1747] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:12 2022] DELETE /identity/v3/projects/d0ed67036b884875ba45a72ec2f6bba6 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:12.738925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.741412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe2887-0ed0-49a9-a4e9-3e93823c993e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.744796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.775263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea74c06a-79af-45fc-8b7c-57a817aaab90 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.784867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.785686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.786107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.786432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.787232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.789642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.803652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 891/1748] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:12.804774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.807937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.824853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b8fad-bbc0-412c-8c3a-775c61aaf3ed admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.830280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.836509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.836509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.836509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.836509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:12.836509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.836509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.852618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 892/1749] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:12.852618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.859122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.874343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5159e8-9027-43e6-b0c2-b81c9b505489 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:12.880525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:12.881227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.881659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.881958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.882836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:12.885583 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:12.905629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 858/1750] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/users => generated 282 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:12.907573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b5c1-7ab3-47ad-ace5-0996421cccea None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:12.908577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b5c1-7ab3-47ad-ace5-0996421cccea None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:12.909519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8344b5c1-7ab3-47ad-ace5-0996421cccea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:12.949242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8344b5c1-7ab3-47ad-ace5-0996421cccea None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:12.958519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8344b5c1-7ab3-47ad-ace5-0996421cccea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:12.982887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 859/1751] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:12.982887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b5c1-7ab3-47ad-ace5-0996421cccea None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:12.995987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8344b5c1-7ab3-47ad-ace5-0996421cccea None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.001874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.002888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.003243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.003802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] PATH_INFO: `/v3/projects/496a0de63a20493ca9819cce822ab843/users/ac2050d040f24e8eaea13e3d4a4afbc3/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.007633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] RBAC: Authorizing `identity:create_grant(project_id=496a0de63a20493ca9819cce822ab843, user_id=ac2050d040f24e8eaea13e3d4a4afbc3, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.011764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.037603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 860/1752] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:12 2022] PUT /identity/v3/projects/496a0de63a20493ca9819cce822ab843/users/ac2050d040f24e8eaea13e3d4a4afbc3/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:13.038673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.070703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 893/1753] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:12 2022] POST /identity/v3/projects => generated 365 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:13.075257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.103520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:13.231237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ce382e-c6fb-4f9d-9743-5ec5611e1433 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.249886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:13.313272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ad3bf-c60c-4737-8f5a-d6a05553d7ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.313272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad3bf-c60c-4737-8f5a-d6a05553d7ed admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.313272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad3bf-c60c-4737-8f5a-d6a05553d7ed admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.314058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ad3bf-c60c-4737-8f5a-d6a05553d7ed admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.314058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ad3bf-c60c-4737-8f5a-d6a05553d7ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.318043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ad3bf-c60c-4737-8f5a-d6a05553d7ed admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.334347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed252e7-3d22-43bf-86cd-b993b4fc9bd8 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.352737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dd40a8-07c1-446e-94b3-39fb3f2ffebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.352737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd40a8-07c1-446e-94b3-39fb3f2ffebb admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.352737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd40a8-07c1-446e-94b3-39fb3f2ffebb admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.352737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dd40a8-07c1-446e-94b3-39fb3f2ffebb admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.353003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd40a8-07c1-446e-94b3-39fb3f2ffebb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.358404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dd40a8-07c1-446e-94b3-39fb3f2ffebb admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.390445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 894/1754] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:13.390445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f6ac-a2a2-403f-8723-708c3e55bfe7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.390445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f6ac-a2a2-403f-8723-708c3e55bfe7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.390445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b8f6ac-a2a2-403f-8723-708c3e55bfe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.411860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 861/1755] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:13 2022] POST /identity/v3/projects => generated 371 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:13.413309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7d34f-50fb-4056-ae01-aa14357e8f89 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.416199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7d34f-50fb-4056-ae01-aa14357e8f89 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.417458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7d34f-50fb-4056-ae01-aa14357e8f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.433179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-35b8f6ac-a2a2-403f-8723-708c3e55bfe7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:13.434497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-35b8f6ac-a2a2-403f-8723-708c3e55bfe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:13.490053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c5a7d34f-50fb-4056-ae01-aa14357e8f89 None None] MFA Rules not processed for user `ac2050d040f24e8eaea13e3d4a4afbc3`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:13.491403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c5a7d34f-50fb-4056-ae01-aa14357e8f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:13.565895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 895/1756] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:13.566900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f6ac-a2a2-403f-8723-708c3e55bfe7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.605086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b8f6ac-a2a2-403f-8723-708c3e55bfe7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.623789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.624365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.624653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.624928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.625567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.635527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.669649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 862/1757] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:13.669649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7d34f-50fb-4056-ae01-aa14357e8f89 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.691684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7d34f-50fb-4056-ae01-aa14357e8f89 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.709194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.709194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.709194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.709194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.709462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.710381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.728945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 863/1758] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:13.729879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.743520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b1df93-0449-4c6d-9afa-7710902f44a7 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.749646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.750345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.750967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.751311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.752105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.754333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.766846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 896/1759] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:13 2022] POST /identity/v3/users => generated 283 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:13.766846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.787448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261113fa-dafb-4f96-ab39-67c3388a0c98 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.788459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:13.793890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.794587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.795013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.795351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.796076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:13.796440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.798454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.812995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 897/1760] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:13.818321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.822627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:13.868157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 864/1761] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:13 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:13.869922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.886882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1061c-dea9-4b3c-bd57-3a10f0fe6838 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.895233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.895926 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.896218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.896556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] PATH_INFO: `/v3/projects/64dfec01f127448185a5e536e62fe02b/users/3c592745f6834b4bb7bcaa1c29938b80/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.913942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8c5ae-3838-448b-bba6-a63e51094c0a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.914978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64dfec01f127448185a5e536e62fe02b, user_id=3c592745f6834b4bb7bcaa1c29938b80, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.917831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.918241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.918921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.919217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.919495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.929872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.931417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.941783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 898/1762] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:13.942706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:13.953853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec77664-c7e4-4def-b9aa-ffe62fb93f94 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:13.960829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:13.962183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:13.962930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:13.963355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:13.964163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:13.966279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:13.980974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 899/1763] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:13 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:13.981853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.002046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056c0fa7-308e-4ebb-b327-9881c93eec30 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.011976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7cba1-2af9-48bb-b66b-70cb5f51ae04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.011976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7cba1-2af9-48bb-b66b-70cb5f51ae04 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.011976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7cba1-2af9-48bb-b66b-70cb5f51ae04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.011976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7cba1-2af9-48bb-b66b-70cb5f51ae04 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.012657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7cba1-2af9-48bb-b66b-70cb5f51ae04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.014619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7cba1-2af9-48bb-b66b-70cb5f51ae04 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.038726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 865/1764] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:13 2022] PUT /identity/v3/projects/64dfec01f127448185a5e536e62fe02b/users/3c592745f6834b4bb7bcaa1c29938b80/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:14.038726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.116679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18156c-1d58-4339-a473-96f121768b16 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.127794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.127794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.127794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.127794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.128406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.129032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.144535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 866/1765] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:14.145665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.148546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 900/1766] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:13 2022] POST /identity/v3/projects => generated 367 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:14.150089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b561-a281-4eea-9c7b-2581c0bec9fa None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.150513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b561-a281-4eea-9c7b-2581c0bec9fa None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.151244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c3b561-a281-4eea-9c7b-2581c0bec9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.161617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb49dc3e-fd8a-47b9-9fd7-c3da8c231a06 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.208565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-b1c3b561-a281-4eea-9c7b-2581c0bec9fa None None] MFA Rules not processed for user `3c592745f6834b4bb7bcaa1c29938b80`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:14.209846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b1c3b561-a281-4eea-9c7b-2581c0bec9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:14.271249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.271249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.271249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.271249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.271615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.273228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.285083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 867/1767] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:14.289442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.310946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 901/1768] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:14.315848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b561-a281-4eea-9c7b-2581c0bec9fa None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.327399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c3b561-a281-4eea-9c7b-2581c0bec9fa None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.332857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.333516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.333863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.334210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.335005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.337047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.387029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fe68be-a0f5-4703-a2d1-12b4e2c9eb3c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.387678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 902/1769] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:14.387678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.387870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.387870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.387870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.387870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.388224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:14.388315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd78df8-8408-4457-91a5-b2e3aa481779 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.388315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.388315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.388315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.388631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.388631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.388631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.418528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.420089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.430417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 868/1770] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:14.431174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.445521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed492fb-4784-475c-af4e-4a0e331037b4 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.448910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.449602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.449980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.450269 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] PATH_INFO: `/v3/projects/a2622b51158145da9958b05cf9d93a62/users/adfe5135a83246718dfe93a86581ca0d/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.469372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2622b51158145da9958b05cf9d93a62, user_id=adfe5135a83246718dfe93a86581ca0d, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.472167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.649508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 903/1771] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:14 2022] POST /identity/v3/users => generated 284 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:14.651369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.658534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 869/1772] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:14 2022] PUT /identity/v3/projects/a2622b51158145da9958b05cf9d93a62/users/adfe5135a83246718dfe93a86581ca0d/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:14.658534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.685625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94720652-374f-42d3-b63e-ec13ce4ae945 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.767531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:14.803504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052c74c-e034-4cb0-88a3-38aba1306b4a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:14.807683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae826bae-f691-433a-979d-7cdee28bd559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.808571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826bae-f691-433a-979d-7cdee28bd559 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.808903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826bae-f691-433a-979d-7cdee28bd559 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.809140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae826bae-f691-433a-979d-7cdee28bd559 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.809780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae826bae-f691-433a-979d-7cdee28bd559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.810687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:14.811680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.811968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.812174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae826bae-f691-433a-979d-7cdee28bd559 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.812277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] PATH_INFO: `/v3/projects/a55a3b843caf4312a0d697970d9d3098/users/9f00e8ef143e4218a8a2e31a5fddd869/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.829613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a55a3b843caf4312a0d697970d9d3098, user_id=9f00e8ef143e4218a8a2e31a5fddd869, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:14.832576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:14.934524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 870/1773] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:14 2022] PUT /identity/v3/projects/a55a3b843caf4312a0d697970d9d3098/users/9f00e8ef143e4218a8a2e31a5fddd869/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:14.935660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:14.947630 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 904/1774] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:14 2022] POST /identity/v3/projects => generated 363 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:14.949717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143aa32-907b-4bd5-b13d-7516f83d5cb8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:14.950403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143aa32-907b-4bd5-b13d-7516f83d5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:14.950902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9143aa32-907b-4bd5-b13d-7516f83d5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:14.982209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9143aa32-907b-4bd5-b13d-7516f83d5cb8 None None] MFA Rules not processed for user `adfe5135a83246718dfe93a86581ca0d`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:14.983493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9143aa32-907b-4bd5-b13d-7516f83d5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:15.011280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51428aaf-4fac-4bae-ba0e-e29a98b238f7 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.127212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.127835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.128116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.128389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.129044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.143681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.168811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 871/1775] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:15.168811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.179716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bca64b-a145-4091-8989-f547c346c143 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.190245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 905/1776] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:14 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:15.191708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10f94-6280-47bf-90a6-3276621734ab None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.194371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10f94-6280-47bf-90a6-3276621734ab None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.194646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b10f94-6280-47bf-90a6-3276621734ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.203188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.203188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.203188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.203188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.204179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.211898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.249086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-00b10f94-6280-47bf-90a6-3276621734ab None None] MFA Rules not processed for user `9f00e8ef143e4218a8a2e31a5fddd869`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:15.251177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-00b10f94-6280-47bf-90a6-3276621734ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:15.306679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:15.339401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 906/1777] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:15.340671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10f94-6280-47bf-90a6-3276621734ab None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.363046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b10f94-6280-47bf-90a6-3276621734ab None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.368796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.369463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.370289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.370582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.371308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.373281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.385406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 872/1778] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:15 2022] POST /identity/v3/users => generated 288 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:15.386755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.395721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 907/1779] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:15.396723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.404329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfad71b-1f49-4021-b4da-45fc20f7d0a1 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.411816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.412013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45617203-8d77-4ad2-b5ac-59b2338efa0e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.412958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.413249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.413529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.414208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.421376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.421376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.421376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.421376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.421949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.422978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.423680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.525103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 908/1780] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:15 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:15.527529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.530905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 873/1781] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:15 2022] POST /identity/v3/projects => generated 365 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:15.531831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.598253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea834d-7056-4a45-b340-8436481bd578 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.604818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd26db-1435-412f-86b9-391812365b6b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.604948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.604948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.604948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.604948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] PATH_INFO: `/v3/projects/1018ee66ee924350ab74d380d97c480f/users/1863dc2bb9d64580b78da014940ad796/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.606236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.606879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.607167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.607447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.608113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.609756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.620697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 909/1782] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:15.621040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1018ee66ee924350ab74d380d97c480f, user_id=1863dc2bb9d64580b78da014940ad796, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.621521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.624825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.633500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06ceb1-c97c-4089-ad51-894410f57cd4 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.638470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.639129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.639399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.639680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.640354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.642247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.727148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 874/1783] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:15 2022] PUT /identity/v3/projects/1018ee66ee924350ab74d380d97c480f/users/1863dc2bb9d64580b78da014940ad796/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:15.728423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.760916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:15.761176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 910/1784] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:15 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:15.761913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.774322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a1de91-85ba-455f-8fd9-cbe12ec36d41 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.832834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd7192d-1ced-4213-b864-6a101e7cfa8d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:15.837784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49606c1-0ff4-4253-9254-f0f80fdce60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.838611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49606c1-0ff4-4253-9254-f0f80fdce60d admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.839052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49606c1-0ff4-4253-9254-f0f80fdce60d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.839334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49606c1-0ff4-4253-9254-f0f80fdce60d admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.839985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49606c1-0ff4-4253-9254-f0f80fdce60d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.841934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49606c1-0ff4-4253-9254-f0f80fdce60d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.850834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:15.851629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.852055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.852427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] PATH_INFO: `/v3/projects/e16a3072e9fc46a18102b790deeedc92/users/70108542075844a29039ee057dacb97a/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.872630 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16a3072e9fc46a18102b790deeedc92, user_id=70108542075844a29039ee057dacb97a, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:15.876108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:15.919248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 875/1785] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:15 2022] POST /identity/v3/users => generated 289 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:15.919248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4109ad-c818-4c14-bc2e-a05fae1f0387 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:15.919248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4109ad-c818-4c14-bc2e-a05fae1f0387 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:15.919248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4109ad-c818-4c14-bc2e-a05fae1f0387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:15.933340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:15.942505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 911/1786] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:15 2022] PUT /identity/v3/projects/e16a3072e9fc46a18102b790deeedc92/users/70108542075844a29039ee057dacb97a/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:15.943778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:15.963280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-cd4109ad-c818-4c14-bc2e-a05fae1f0387 None None] MFA Rules not processed for user `1863dc2bb9d64580b78da014940ad796`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:15.964851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cd4109ad-c818-4c14-bc2e-a05fae1f0387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:16.020590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9581929-187b-4114-9d8c-d9673e303afa admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.030784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.031503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.031818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.032243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.032998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.035413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.049602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 876/1787] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:16.049602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4109ad-c818-4c14-bc2e-a05fae1f0387 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.049839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 912/1788] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:16.049839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.060540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a600e5-a870-4d07-b1c6-475e2978a748 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.061209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4109ad-c818-4c14-bc2e-a05fae1f0387 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.066082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.066321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.066704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.067026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.067309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.067847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.067963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.068406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.068849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.069663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.069761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.072101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.082891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 913/1789] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:16.083272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 877/1790] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:16.084001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.084417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.095216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc728d1-1612-43b3-a2b8-8d06c62b9422 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.095885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb41637-cf6f-4b2a-9c47-bd832a6ea9c0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.100231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.100898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.101149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.101277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.102055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] PATH_INFO: `/v3/projects/f0f532fc77b54e9bbeaffbf0a875295b/users/e72fee76c3c2403a98645af8094be17b/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.102299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.102586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.102900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.103539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.105525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.118635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f532fc77b54e9bbeaffbf0a875295b, user_id=e72fee76c3c2403a98645af8094be17b, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.125285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.160959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:16.246061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 914/1791] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:16 2022] POST /identity/v3/projects => generated 369 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:16.246061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.271871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 878/1792] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:16 2022] PUT /identity/v3/projects/f0f532fc77b54e9bbeaffbf0a875295b/users/e72fee76c3c2403a98645af8094be17b/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:16.278982 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.382468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16761ca-eefe-4617-aa99-839028f55ea5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.407173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:16.432588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6261987-77f3-4a8e-8108-feb50ab1fe13 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.446791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.447684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.448075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.449384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] PATH_INFO: `/v3/projects/e16a3072e9fc46a18102b790deeedc92/users/70108542075844a29039ee057dacb97a/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.456609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e16a3072e9fc46a18102b790deeedc92, user_id=70108542075844a29039ee057dacb97a, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.462481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.489609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 879/1793] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:16 2022] PUT /identity/v3/projects/e16a3072e9fc46a18102b790deeedc92/users/70108542075844a29039ee057dacb97a/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:16.489609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.489609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:16.503575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.504165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.504454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.504737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] PATH_INFO: `/v3/projects/747545ac63274ad8ab9260977887dbe2/users/d4b0dd98070844daae54047108826297/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.522597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=747545ac63274ad8ab9260977887dbe2, user_id=d4b0dd98070844daae54047108826297, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.527242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.584466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d29c4c6-7621-4c3d-ba4e-80038e2ea88b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.590350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16eef06e-02da-4ace-8d23-2bb652108600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.591119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef06e-02da-4ace-8d23-2bb652108600 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.591584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef06e-02da-4ace-8d23-2bb652108600 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.591871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16eef06e-02da-4ace-8d23-2bb652108600 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.592598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eef06e-02da-4ace-8d23-2bb652108600 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.594566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16eef06e-02da-4ace-8d23-2bb652108600 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.665139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 915/1794] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:16 2022] PUT /identity/v3/projects/747545ac63274ad8ab9260977887dbe2/users/d4b0dd98070844daae54047108826297/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:16.665992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.707327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 880/1795] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:16 2022] POST /identity/v3/users => generated 291 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:16.708749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d45e-1ffe-4f4c-b065-d44a6912fdd8 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.709040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d45e-1ffe-4f4c-b065-d44a6912fdd8 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.709319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c71d45e-1ffe-4f4c-b065-d44a6912fdd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.746665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97642ee2-a8ed-441a-ac5c-68a48e8b5c9f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.751687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.752453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.752742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.753344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.754427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.756338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.774696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1c71d45e-1ffe-4f4c-b065-d44a6912fdd8 None None] MFA Rules not processed for user `70108542075844a29039ee057dacb97a`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:16.778350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 916/1796] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:16.779202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.780448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1c71d45e-1ffe-4f4c-b065-d44a6912fdd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:16.794271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96007c56-a416-4237-a9d9-85b0837cbad5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.803722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.805606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.806123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.806742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.807811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.810366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.855432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 917/1797] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:16.855432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.867156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3deb89d-4040-4f09-9b3a-2837dafab1cc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.873373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.876507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.876507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.876507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.876507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.888772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:16.922350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 918/1798] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:16 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:16.931179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:16.958710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc6a90f-e7f5-4d1b-8b3f-a1ff362a5e96 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:16.966322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:16.967138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:16.967480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:16.967919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] PATH_INFO: `/v3/projects/f0f532fc77b54e9bbeaffbf0a875295b/users/e72fee76c3c2403a98645af8094be17b/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:16.970589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f532fc77b54e9bbeaffbf0a875295b, user_id=e72fee76c3c2403a98645af8094be17b, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:16.993790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:17.014555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 881/1799] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:17.030215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:17.031049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 919/1800] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:16 2022] PUT /identity/v3/projects/f0f532fc77b54e9bbeaffbf0a875295b/users/e72fee76c3c2403a98645af8094be17b/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:17.032480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:17.040595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d45e-1ffe-4f4c-b065-d44a6912fdd8 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:17.066018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c71d45e-1ffe-4f4c-b065-d44a6912fdd8 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:17.124771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:17.218595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:17.220735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:17.221831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:17.222194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] PATH_INFO: `/v3/projects/747545ac63274ad8ab9260977887dbe2/users/d4b0dd98070844daae54047108826297/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:17.227141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] RBAC: Authorizing `identity:create_grant(project_id=747545ac63274ad8ab9260977887dbe2, user_id=d4b0dd98070844daae54047108826297, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:17.234456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:17.241301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68c60d-6627-4fa8-9adf-35f861458c34 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:17.252024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32e872d-4ca9-40cc-b741-5d32cc51eb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:17.256146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e872d-4ca9-40cc-b741-5d32cc51eb4e admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:17.256571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e872d-4ca9-40cc-b741-5d32cc51eb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:17.256919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32e872d-4ca9-40cc-b741-5d32cc51eb4e admin admin] PATH_INFO: `/v3/projects/52994b4910c24529b1179a0de3db91ee/users/3bdb2c287263407989c6c1b422d284b8/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:17.268064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 882/1801] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:17 2022] PUT /identity/v3/projects/747545ac63274ad8ab9260977887dbe2/users/d4b0dd98070844daae54047108826297/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:17.268064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:17.298867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e872d-4ca9-40cc-b741-5d32cc51eb4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52994b4910c24529b1179a0de3db91ee, user_id=3bdb2c287263407989c6c1b422d284b8, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:17.308122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32e872d-4ca9-40cc-b741-5d32cc51eb4e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:17.362029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e23538-8280-4bbf-b551-47f32d269606 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:17.366718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb1d7d0-8913-4192-9c8c-01c1864f928d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:17.368080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1d7d0-8913-4192-9c8c-01c1864f928d service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:17.368565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1d7d0-8913-4192-9c8c-01c1864f928d service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:17.369816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb1d7d0-8913-4192-9c8c-01c1864f928d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:17.414706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 920/1802] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:17 2022] PUT /identity/v3/projects/52994b4910c24529b1179a0de3db91ee/users/3bdb2c287263407989c6c1b422d284b8/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:17.419564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951d43-d799-4d21-bbe1-c2fdb7d4cd20 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:17.420996 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951d43-d799-4d21-bbe1-c2fdb7d4cd20 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:17.422191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a951d43-d799-4d21-bbe1-c2fdb7d4cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:17.486108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1d7d0-8913-4192-9c8c-01c1864f928d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:17.488200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb1d7d0-8913-4192-9c8c-01c1864f928d service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:17.504361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9a951d43-d799-4d21-bbe1-c2fdb7d4cd20 None None] MFA Rules not processed for user `e72fee76c3c2403a98645af8094be17b`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:17.509580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9a951d43-d799-4d21-bbe1-c2fdb7d4cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:17.516467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 883/1803] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:17.520260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a60f-5ce1-4b61-bda1-8225df81426c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:17.520891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a60f-5ce1-4b61-bda1-8225df81426c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:17.522155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a1a60f-5ce1-4b61-bda1-8225df81426c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:17.533261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:17.598408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f9a1a60f-5ce1-4b61-bda1-8225df81426c None None] MFA Rules not processed for user `d4b0dd98070844daae54047108826297`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:17.599896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f9a1a60f-5ce1-4b61-bda1-8225df81426c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:17.704555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:17.725712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 921/1804] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:17 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:17.728343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:17.729793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1c51-752f-41f6-b4ad-387f127a5b87 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:17.730246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1c51-752f-41f6-b4ad-387f127a5b87 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:17.730907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb1c51-752f-41f6-b4ad-387f127a5b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:17.808323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 884/1805] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:17.808323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a60f-5ce1-4b61-bda1-8225df81426c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:17.830704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-64bb1c51-752f-41f6-b4ad-387f127a5b87 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:17.834693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-64bb1c51-752f-41f6-b4ad-387f127a5b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:17.910673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:17.941061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 922/1806] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:58:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:17.943752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1c51-752f-41f6-b4ad-387f127a5b87 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:17.954163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a1a60f-5ce1-4b61-bda1-8225df81426c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:17.956559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:17.965223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:17.966035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:17.966299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:17.966578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:17.967438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:17.968968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:17.998838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 885/1807] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:17.998838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:17.998838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:18.036393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb1c51-752f-41f6-b4ad-387f127a5b87 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:18.040537 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:18.041188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.041468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.041750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.052511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:18.054022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:18.067067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 923/1808] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:17 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:18.068056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:18.080848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e910fd-9d58-464f-9210-096391d45638 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:18.089431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f92fcc7-74f8-4dab-a0d8-8bec16f6d037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:18.089431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92fcc7-74f8-4dab-a0d8-8bec16f6d037 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.089431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92fcc7-74f8-4dab-a0d8-8bec16f6d037 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.089431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f92fcc7-74f8-4dab-a0d8-8bec16f6d037 admin admin] PATH_INFO: `/v3/projects/52994b4910c24529b1179a0de3db91ee/users/3bdb2c287263407989c6c1b422d284b8/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.091350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92fcc7-74f8-4dab-a0d8-8bec16f6d037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52994b4910c24529b1179a0de3db91ee, user_id=3bdb2c287263407989c6c1b422d284b8, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:18.094166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f92fcc7-74f8-4dab-a0d8-8bec16f6d037 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:18.117044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 924/1809] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:18 2022] PUT /identity/v3/projects/52994b4910c24529b1179a0de3db91ee/users/3bdb2c287263407989c6c1b422d284b8/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:18.118667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:18.121164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc554-bb61-4f0e-9b74-d73a3da01b52 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.121475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc554-bb61-4f0e-9b74-d73a3da01b52 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.122951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55fc554-bb61-4f0e-9b74-d73a3da01b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.143167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9725a6-9c8e-414d-888d-4579ea6bfdca admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:18.167991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:18.185438 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f55fc554-bb61-4f0e-9b74-d73a3da01b52 None None] MFA Rules not processed for user `3bdb2c287263407989c6c1b422d284b8`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:18.189061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f55fc554-bb61-4f0e-9b74-d73a3da01b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:18.220135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:18.221531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.222043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.223106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.341900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 925/1810] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:18.343778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc554-bb61-4f0e-9b74-d73a3da01b52 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:18.348821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:18.350778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:18.363088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 886/1811] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:17 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:18.363378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:18.364763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:18.448719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55fc554-bb61-4f0e-9b74-d73a3da01b52 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:18.456992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:18.458600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.458600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.458600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] PATH_INFO: `/v3/users/d64fc40dd2b845b2a4cc34fa9a36347e` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.467900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d64fc40dd2b845b2a4cc34fa9a36347e)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:18.467900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:18.507454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1d7d2-8f4f-4aca-a6fc-a564832964c0 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:18.515633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:18.517202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.517674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.518197 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.629099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:18.630867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:18.640352 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 887/1812] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 06:58:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:58:18.641837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:18.654038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0b19f-e4b1-4b7b-9ba0-4c3e6f41d78b service swift] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:18.658717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:18.659570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.659842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.660113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.687169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:18.696511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:18.740339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 888/1813] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:18.744080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:18.769043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b14ce-12d1-48fa-bacb-38bedfd9e958 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:18.775211 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd64fc40dd2b845b2a4cc34fa9a36347e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:18.778284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd64fc40dd2b845b2a4cc34fa9a36347e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:18.780497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c3274e-a515-4371-91bd-03b5655ef2c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:18.780497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3274e-a515-4371-91bd-03b5655ef2c2 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.780497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3274e-a515-4371-91bd-03b5655ef2c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.780497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c3274e-a515-4371-91bd-03b5655ef2c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.781728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-78c3274e-a515-4371-91bd-03b5655ef2c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:18.850569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:18.858321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd64fc40dd2b845b2a4cc34fa9a36347e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:18.872079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd64fc40dd2b845b2a4cc34fa9a36347e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:18.884926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:18.927185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3274e-a515-4371-91bd-03b5655ef2c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:18.927396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-aa1a0469-db16-4f20-b6be-b6c3c06fbe33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd64fc40dd2b845b2a4cc34fa9a36347e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:18.929010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c3274e-a515-4371-91bd-03b5655ef2c2 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:18.949236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 926/1814] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:18 2022] DELETE /identity/v3/users/d64fc40dd2b845b2a4cc34fa9a36347e => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:18.952628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.953981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.956304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:18.960849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 889/1815] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:18 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:18.967236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:18.967998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:18.968389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:19.035686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:19.038016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] MFA Rules not processed for user `60b49283ccd0414389601e5e6f339c45`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:19.040099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.043301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.185730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 890/1816] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:19.187110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:19.190334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 927/1817] 10.222.0.27 () {58 vars in 1015 bytes} [Wed Aug 24 06:58:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:19.205887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.227885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:19.231221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.270897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd9c303-77f0-47ee-9191-edce0e9138ae None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:19.287547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:19.290627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:19.292578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:19.292864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:19.327816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:19.327816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:19.357123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 928/1818] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:19.358295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:19.362283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.410067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0e4df-ec4a-432e-ba78-e16278861101 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:19.417785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff77d9e-c71a-4377-acca-2a3b998abaf0 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:19.422671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:19.423341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:19.423622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:19.423887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:19.428315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.432615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:19.433568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:19.433820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:19.434106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:19.456623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:19.463165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:19.497712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 929/1819] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:19.498359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:19.516893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b6c6e-019c-4787-a910-83a770a4872b service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:19.531841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:19.532808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:19.533375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:19.534079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:19.572451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:19.575096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:19.576609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:19.587277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:19.595629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 891/1820] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:19.622834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 930/1821] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:19.663808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:19.666045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.693551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f93c3f0-8a31-444d-a7c4-778d828345f4 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:19.699228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:19.707426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e7d480-0b20-43c6-aac8-9d17df58e48d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:19.709759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d480-0b20-43c6-aac8-9d17df58e48d service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:19.710923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d480-0b20-43c6-aac8-9d17df58e48d service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:19.711423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e7d480-0b20-43c6-aac8-9d17df58e48d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:19.715825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-35e7d480-0b20-43c6-aac8-9d17df58e48d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:19.800503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:19.862720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d480-0b20-43c6-aac8-9d17df58e48d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:19.864327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e7d480-0b20-43c6-aac8-9d17df58e48d service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:19.893364 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 892/1822] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:20.132632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:21.276216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:21.446582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:21.745192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:21.746878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:21.763271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8755194-f113-4e1f-a379-4d65d25e2a22 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:21.774454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:21.775103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:21.775234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:21.775743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] PATH_INFO: `/v3/projects/8adfc9fa3cd84a7c92bd3daca1fd5900` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:21.777043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] RBAC: Authorizing `identity:delete_project(project_id=8adfc9fa3cd84a7c92bd3daca1fd5900)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:21.779408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:21.935454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8adfc9fa3cd84a7c92bd3daca1fd5900', 'request_id': 'req-2fce8562-9f7d-4025-94aa-ef57a672417e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:21.946593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8adfc9fa3cd84a7c92bd3daca1fd5900', 'request_id': 'req-2fce8562-9f7d-4025-94aa-ef57a672417e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:21.991594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a63e4e-bf7e-420f-a1ca-1e5598e05f37 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:21.992248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a63e4e-bf7e-420f-a1ca-1e5598e05f37 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:21.992719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a63e4e-bf7e-420f-a1ca-1e5598e05f37 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:21.995597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 893/1823] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 06:58:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:58:22.008006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:22.008328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:22.008588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:22.049423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8adfc9fa3cd84a7c92bd3daca1fd5900', 'request_id': 'req-2fce8562-9f7d-4025-94aa-ef57a672417e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.080940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] The token cache is being invalidate because project 8adfc9fa3cd84a7c92bd3daca1fd5900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:22.081335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.084450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.089191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:22.099088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:22.101073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 931/1824] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:21 2022] DELETE /identity/v3/projects/8adfc9fa3cd84a7c92bd3daca1fd5900 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:22.102621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:22.105647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:22.299993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce8562-9f7d-4025-94aa-ef57a672417e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:22.354341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:22.354341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:22.354341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:22.354341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] PATH_INFO: `/v3/users/ac2050d040f24e8eaea13e3d4a4afbc3` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:22.355109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2050d040f24e8eaea13e3d4a4afbc3)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:22.355109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:22.355373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 894/1825] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 06:58:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:22.355373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:22.355373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:22.355373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bd350f-50e1-46e8-81a3-212c97f82df4 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:22.356134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:22.356134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:22.356134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:22.356134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] PATH_INFO: `/v3/users/3c592745f6834b4bb7bcaa1c29938b80` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:22.356426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c592745f6834b4bb7bcaa1c29938b80)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:22.356426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:22.747451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c592745f6834b4bb7bcaa1c29938b80'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.749040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c592745f6834b4bb7bcaa1c29938b80'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.750001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2050d040f24e8eaea13e3d4a4afbc3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.751272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2050d040f24e8eaea13e3d4a4afbc3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.908030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c592745f6834b4bb7bcaa1c29938b80'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.925492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:22.955894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c592745f6834b4bb7bcaa1c29938b80'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:22.985339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c592745f6834b4bb7bcaa1c29938b80'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:23.020608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 895/1826] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:22 2022] DELETE /identity/v3/users/3c592745f6834b4bb7bcaa1c29938b80 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:23.021571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:23.027010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2050d040f24e8eaea13e3d4a4afbc3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:23.033166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2050d040f24e8eaea13e3d4a4afbc3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:23.035479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:23.077660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-78dadc37-46d3-4eb7-96ea-7d63cd3ff478 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2050d040f24e8eaea13e3d4a4afbc3'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:23.109649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 932/1827] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:22 2022] DELETE /identity/v3/users/ac2050d040f24e8eaea13e3d4a4afbc3 => generated 0 bytes in 1008 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:23.114139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b172-f7b4-4175-a420-5099b528e980 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:23.116377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b172-f7b4-4175-a420-5099b528e980 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:23.119105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48b172-f7b4-4175-a420-5099b528e980 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:23.119105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 933/1828] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 06:58:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:58:23.119457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e1c81-71e7-4fa7-94cb-5891be41a1ba None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:23.129773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e1c81-71e7-4fa7-94cb-5891be41a1ba None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:23.130680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761e1c81-71e7-4fa7-94cb-5891be41a1ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:23.212376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-761e1c81-71e7-4fa7-94cb-5891be41a1ba None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:23.217896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-761e1c81-71e7-4fa7-94cb-5891be41a1ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:23.233646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:23.261835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9129b1d1-6ea8-4306-bb87-77b4171eb80f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:23.400007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 934/1829] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:23.409974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:23.410312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:23.410607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:23.492331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:23.495592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:23.529589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 935/1830] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 06:58:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:23.530952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:23.532545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:23.537696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:23.538401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:23.543522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:23.544987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:23.550439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:23.602201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:23.604014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:23.633433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef50dadc-90a5-4835-9c2b-fc1a5f00691d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:23.636656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 896/1831] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:23.639553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:23.643112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:23.643112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:23.643112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:23.668393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:23.670956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:23.685763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 936/1832] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:24.075455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:24.077102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:24.132027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030ce876-dd27-4d76-ad96-16633729b5d8 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:24.144933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:24.147864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:24.148313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:24.148795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:24.164704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:24.167489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:24.268693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 897/1833] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:25.148342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:25.150066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:25.182044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29c527-1715-4e1c-b1fe-6dbe177e214c service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:25.208032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:25.209394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:25.209941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:25.210500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] PATH_INFO: `/v3/projects/64dfec01f127448185a5e536e62fe02b` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:25.212790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64dfec01f127448185a5e536e62fe02b)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:25.214996 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:25.481463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64dfec01f127448185a5e536e62fe02b', 'request_id': 'req-4e00e0ac-1598-4f9b-8952-7c3f57349229'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:25.525556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64dfec01f127448185a5e536e62fe02b', 'request_id': 'req-4e00e0ac-1598-4f9b-8952-7c3f57349229'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:25.582485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:25.584012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:25.659891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66c3583-aaf3-4ddc-bdbc-cf4857bcb861 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:25.685811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64dfec01f127448185a5e536e62fe02b', 'request_id': 'req-4e00e0ac-1598-4f9b-8952-7c3f57349229'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:25.735634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] The token cache is being invalidate because project 64dfec01f127448185a5e536e62fe02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:25.735936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:25.736809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:25.742231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 937/1834] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:25 2022] DELETE /identity/v3/projects/64dfec01f127448185a5e536e62fe02b => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:25.749318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:25.749318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:25.851956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:25.901998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:25.902673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:25.902993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:25.903278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] PATH_INFO: `/v3/projects/496a0de63a20493ca9819cce822ab843` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:25.905566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=496a0de63a20493ca9819cce822ab843)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:25.909408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:25.924118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00e0ac-1598-4f9b-8952-7c3f57349229 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:25.938945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:25.938945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:25.939776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:25.940071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] PATH_INFO: `/v3/users/70108542075844a29039ee057dacb97a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:25.943153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] RBAC: Authorizing `identity:delete_user(user_id=70108542075844a29039ee057dacb97a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:25.946181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:26.139555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496a0de63a20493ca9819cce822ab843', 'request_id': 'req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.165592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496a0de63a20493ca9819cce822ab843', 'request_id': 'req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.175654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496a0de63a20493ca9819cce822ab843', 'request_id': 'req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.247265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70108542075844a29039ee057dacb97a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.250453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70108542075844a29039ee057dacb97a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.303397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] The token cache is being invalidate because project 496a0de63a20493ca9819cce822ab843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:26.304456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.305298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-9d6a4e2a-7ade-4d37-b1ef-c7198a649ff0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.308722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 898/1835] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:25 2022] DELETE /identity/v3/projects/496a0de63a20493ca9819cce822ab843 => generated 0 bytes in 728 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:26.314938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65f960-1a53-48ab-8394-c4bd8b733f5c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:26.315532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65f960-1a53-48ab-8394-c4bd8b733f5c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:26.318297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d65f960-1a53-48ab-8394-c4bd8b733f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:26.326048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:26.353369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0d65f960-1a53-48ab-8394-c4bd8b733f5c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:26.354929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0d65f960-1a53-48ab-8394-c4bd8b733f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:26.388920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70108542075844a29039ee057dacb97a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.398980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70108542075844a29039ee057dacb97a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.448679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-97f00ca6-1924-49a2-877f-a13a1ef1819c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70108542075844a29039ee057dacb97a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:26.472638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 938/1836] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:25 2022] DELETE /identity/v3/users/70108542075844a29039ee057dacb97a => generated 0 bytes in 730 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:26.490867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 899/1837] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:26.500214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a769-e188-44df-820e-a80144566f68 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:26.500555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a769-e188-44df-820e-a80144566f68 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:26.500730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee6a769-e188-44df-820e-a80144566f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:26.541812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3ee6a769-e188-44df-820e-a80144566f68 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:26.543524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3ee6a769-e188-44df-820e-a80144566f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:26.656603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 939/1838] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:26.701962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65f960-1a53-48ab-8394-c4bd8b733f5c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:26.712819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d65f960-1a53-48ab-8394-c4bd8b733f5c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:26.733767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:26.735073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:26.810899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:26.810899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:26.810899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:26.810899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:26.810899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:26.810899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 900/1839] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:26.813153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a769-e188-44df-820e-a80144566f68 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:26.828171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee6a769-e188-44df-820e-a80144566f68 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:26.835442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:26.837559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:26.837847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:26.838241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:26.839109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:26.848302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:27.182023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 940/1840] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:26 2022] POST /identity/v3/projects => generated 379 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:27.183268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:27.205699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fe5453-8fdc-4d6f-9e4a-e92da04d043b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:27.328539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:27.329862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:27.330672 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:27.330998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:27.331690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:27.333977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:27.465597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 901/1841] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:27 2022] POST /identity/v3/users => generated 290 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:27.466982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:27.486256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f70b46-b73d-4136-bd18-b6f94efd2096 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:27.494230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:27.495373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:27.495770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:27.496215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:27.497246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:27.499357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:27.512313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 941/1842] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:27.516772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:27.534563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a67d2c-ba55-4285-b1d5-7fbeaca739f1 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:27.540920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:27.541650 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:27.542452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:27.542894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:27.545052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:27.547108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:27.562283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 902/1843] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:27.566000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:27.579636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2455-58d6-43c1-a844-5e8bbd208da5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:27.588301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a617c592-a0f4-4362-b926-13e8904f87af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:27.589416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c592-a0f4-4362-b926-13e8904f87af admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:27.589941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c592-a0f4-4362-b926-13e8904f87af admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:27.590546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a617c592-a0f4-4362-b926-13e8904f87af admin admin] PATH_INFO: `/v3/projects/22985891170d452887df72fad4f6d43c/users/69a52cb497584e338d2220a3402df44c/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:27.591044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:27.593873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:27.615999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aae8fdf-106e-49f7-83e0-261a2415cf8f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:27.622652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:27.624142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:27.624251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c592-a0f4-4362-b926-13e8904f87af admin admin] RBAC: Authorizing `identity:create_grant(project_id=22985891170d452887df72fad4f6d43c, user_id=69a52cb497584e338d2220a3402df44c, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:27.624428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:27.624974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] PATH_INFO: `/v3/projects/e16a3072e9fc46a18102b790deeedc92` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:27.626303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e16a3072e9fc46a18102b790deeedc92)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:27.627748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a617c592-a0f4-4362-b926-13e8904f87af admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:27.628342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:27.702305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 942/1844] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:27 2022] PUT /identity/v3/projects/22985891170d452887df72fad4f6d43c/users/69a52cb497584e338d2220a3402df44c/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:27.714951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336cd24-8111-497a-90c8-6b1347b758e6 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:27.715595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336cd24-8111-497a-90c8-6b1347b758e6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:27.715946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f336cd24-8111-497a-90c8-6b1347b758e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:27.754924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f336cd24-8111-497a-90c8-6b1347b758e6 None None] MFA Rules not processed for user `69a52cb497584e338d2220a3402df44c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:27.756982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f336cd24-8111-497a-90c8-6b1347b758e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:27.813441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e16a3072e9fc46a18102b790deeedc92', 'request_id': 'req-cce28a34-5834-48b0-9b62-55c3070978fb'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:27.824465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e16a3072e9fc46a18102b790deeedc92', 'request_id': 'req-cce28a34-5834-48b0-9b62-55c3070978fb'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:27.835977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e16a3072e9fc46a18102b790deeedc92', 'request_id': 'req-cce28a34-5834-48b0-9b62-55c3070978fb'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:27.889679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 943/1845] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:27.893894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336cd24-8111-497a-90c8-6b1347b758e6 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:27.921674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] The token cache is being invalidate because project e16a3072e9fc46a18102b790deeedc92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:27.922278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:27.923697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cce28a34-5834-48b0-9b62-55c3070978fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:27.927107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 903/1846] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:27 2022] DELETE /identity/v3/projects/e16a3072e9fc46a18102b790deeedc92 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:27.932717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6514-53b4-4d65-80a1-aebb44946605 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:27.933313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6514-53b4-4d65-80a1-aebb44946605 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:27.933858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e6514-53b4-4d65-80a1-aebb44946605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:27.999207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-718e6514-53b4-4d65-80a1-aebb44946605 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:28.005073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-718e6514-53b4-4d65-80a1-aebb44946605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:28.007902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f336cd24-8111-497a-90c8-6b1347b758e6 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.080329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 904/1847] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:28.093372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeba8c3-3316-4a64-bbe6-ae4d52cc9e5a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.093748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeba8c3-3316-4a64-bbe6-ae4d52cc9e5a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.094120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeeba8c3-3316-4a64-bbe6-ae4d52cc9e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.118504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.119505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.119795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.120063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.120949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.123192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.123854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-eeeba8c3-3316-4a64-bbe6-ae4d52cc9e5a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:28.125257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-eeeba8c3-3316-4a64-bbe6-ae4d52cc9e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:28.140004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 905/1848] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:28.141539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeba8c3-3316-4a64-bbe6-ae4d52cc9e5a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.154472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeeba8c3-3316-4a64-bbe6-ae4d52cc9e5a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.160066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.160747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.161047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.161371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.162221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:28.162595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.164545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.181975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 906/1849] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:28.186655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.205136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a509b0-84f0-4cec-aa30-4eb0e781517f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.211444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.212323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.212579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.213072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.213838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.216171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.465754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 907/1850] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:28 2022] POST /identity/v3/projects => generated 365 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:28.469992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.476665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 944/1851] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:27 2022] POST /identity/v3/projects => generated 379 bytes in 583 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:28.480230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.487716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:28.641537 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba66865-ad98-40e1-8946-1d094c49fc3d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.649366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3c557c-1580-4f75-bb2f-c500e02294a6 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.655455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.655455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.655455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.655455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.655972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.664579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.668189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.675704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.675704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.676046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.676941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.685835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.807628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 945/1852] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:28 2022] POST /identity/v3/users => generated 290 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:28.807628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.808993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 908/1853] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:28 2022] POST /identity/v3/users => generated 283 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:28.810107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.828545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e416a039-86c1-4c51-8c0e-652a832b219f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.829388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05b2f5-a38c-4510-a114-f9805f5ea947 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.843488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.843488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.843488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.843488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.843951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.843951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.849389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.850321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.851109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.851380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.852045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.854000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.879862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 946/1854] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:28.886997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.887546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 909/1855] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:28.888462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.891054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:28.902831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:28.908992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc21026b-c6df-46f4-9812-03377c68c620 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.909147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a8183-ba8d-4d61-b57a-c71c04bec12a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:28.927843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.929368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.929539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:28.930180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:28.930292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.933990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:28.934141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] PATH_INFO: `/v3/users/1863dc2bb9d64580b78da014940ad796` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.934246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:28.934246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.934246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.935333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=1863dc2bb9d64580b78da014940ad796)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:28.938311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:28.974696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 910/1856] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:28.977470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:28.997477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dbcf2-88e2-46f8-aeff-ddd0f253fbfd admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:29.003205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:29.004099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:29.004333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:29.004709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:29.006000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:29.007651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:29.048142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 911/1857] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:29.050138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:29.078608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43356232-8e7e-493d-9a10-fe3efc56f82e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:29.087704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:29.089103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:29.089667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:29.090143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] PATH_INFO: `/v3/projects/23b36b80178f47dbb53ef713c4a57191/users/87ba8fffabfb49ec9af9d6b50eef790f/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:29.127863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23b36b80178f47dbb53ef713c4a57191, user_id=87ba8fffabfb49ec9af9d6b50eef790f, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:29.131765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:29.215279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1863dc2bb9d64580b78da014940ad796'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:29.217185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1863dc2bb9d64580b78da014940ad796'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:29.249429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 912/1858] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:29 2022] PUT /identity/v3/projects/23b36b80178f47dbb53ef713c4a57191/users/87ba8fffabfb49ec9af9d6b50eef790f/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:29.253395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:29.253395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:29.331447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1863dc2bb9d64580b78da014940ad796'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:29.343957 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1863dc2bb9d64580b78da014940ad796'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:29.350274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108706ad-a2b5-4368-912d-04e5d1ebc172 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:29.360956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d74c705-6807-4186-8c8c-0fa0c4a1790b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:29.367297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74c705-6807-4186-8c8c-0fa0c4a1790b admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:29.367297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74c705-6807-4186-8c8c-0fa0c4a1790b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:29.367297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d74c705-6807-4186-8c8c-0fa0c4a1790b admin admin] PATH_INFO: `/v3/projects/c4417f4409ba47bc9e5df70e194a8d81/users/a18879c6228342be82bea03da451915f/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:29.370616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c536120d-82e3-467e-8358-f5e1a75a61ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1863dc2bb9d64580b78da014940ad796'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:29.390938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74c705-6807-4186-8c8c-0fa0c4a1790b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4417f4409ba47bc9e5df70e194a8d81, user_id=a18879c6228342be82bea03da451915f, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:29.394344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d74c705-6807-4186-8c8c-0fa0c4a1790b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:29.400724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 947/1859] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:28 2022] DELETE /identity/v3/users/1863dc2bb9d64580b78da014940ad796 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:29.405083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516300-ec00-426d-8cef-07b2837fb021 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:29.405934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516300-ec00-426d-8cef-07b2837fb021 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:29.411917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd516300-ec00-426d-8cef-07b2837fb021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:29.481832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-fd516300-ec00-426d-8cef-07b2837fb021 None None] MFA Rules not processed for user `87ba8fffabfb49ec9af9d6b50eef790f`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:29.484379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fd516300-ec00-426d-8cef-07b2837fb021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:29.500108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 913/1860] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:29 2022] PUT /identity/v3/projects/c4417f4409ba47bc9e5df70e194a8d81/users/a18879c6228342be82bea03da451915f/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:29.503529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:29.503529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:29.503529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:29.558345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:29.563819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:29.612781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 948/1861] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:29.615745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:29.617414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:29.617961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:29.685917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] MFA Rules not processed for user `a18879c6228342be82bea03da451915f`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:29.685917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:29.736262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 914/1862] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:29.736262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:29.740837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:29.761662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c0fb74-edfd-4596-a7cd-2ab26cfda1a9 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:29.782928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:29.783667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:29.783964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:29.784246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:29.784896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:29.789394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:29.857210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 949/1863] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:29.857210 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:29.858004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:29.938244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 915/1864] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:29 2022] POST /identity/v3/projects => generated 377 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:29.939707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.006861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a554ee7-e1a3-4b06-b87d-7ef54e0b95f2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.065538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c648c4-1440-4d3f-b2bb-484786d49393 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.079631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.080481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.081839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.082029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.082670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.088357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.106545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.107217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.107549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.107864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.117921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.119453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.131481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 950/1865] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:30.139067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.147838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad703bf-6b12-491f-949b-db5532d44c35 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.162862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.162862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.162862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.162862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.163889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.163889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.251632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 916/1866] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:29 2022] POST /identity/v3/projects => generated 365 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:30.255649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.328738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72d5e91-c007-4cd5-9375-3f99c75c1480 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.337906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.345665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.345665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.345665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.345665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.345986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 951/1867] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:30 2022] POST /identity/v3/users => generated 295 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:30.346092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.346182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.363341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5e120-3fab-4efb-8c73-52674d910e73 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.369309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.370016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.373500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.379889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.382109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.383919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.401766 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 952/1868] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:30.407018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.427519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c307305-d40e-48da-962e-2be66e99366d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.433582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.433810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.434106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.434531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] PATH_INFO: `/v3/projects/6b1ee1a01399487cad96a2b05411b445/users/d79845c2b5af4245b5c3eb5dfcfcfc38/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.452737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1ee1a01399487cad96a2b05411b445, user_id=d79845c2b5af4245b5c3eb5dfcfcfc38, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.461682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.465374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 917/1869] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:30 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:30.469679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.485304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c0cedd-f5f9-4e6b-8317-5213b10a5b3e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.491716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.492442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.492730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.493064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.493734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.495942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.515548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 918/1870] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:30.516421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.528980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae170139-c1d1-41c7-b41d-7f2b56261d8f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.535043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.536475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.536475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.536475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] PATH_INFO: `/v3/projects/4c2af7cd7b834493b5be760e7ec1747f/users/478de02b1fe8404cac372e0409a95ce9/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.554505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2af7cd7b834493b5be760e7ec1747f, user_id=478de02b1fe8404cac372e0409a95ce9, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.557454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.576943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 953/1871] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:30 2022] PUT /identity/v3/projects/6b1ee1a01399487cad96a2b05411b445/users/d79845c2b5af4245b5c3eb5dfcfcfc38/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:30.581110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.641503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c329ba9-befc-4a26-8f7d-0270b78447aa admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.646134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.646738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.647049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.647857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.648479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.650344 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.660424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 954/1872] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:30.665090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.674749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e52ad-ab8e-4806-83e3-3ab8e3f49653 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.679397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539cb343-cdc0-4ade-af13-3707f91f29b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.680038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cb343-cdc0-4ade-af13-3707f91f29b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.680319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cb343-cdc0-4ade-af13-3707f91f29b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.680594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539cb343-cdc0-4ade-af13-3707f91f29b9 admin admin] PATH_INFO: `/v3/projects/6b1ee1a01399487cad96a2b05411b445/users/d79845c2b5af4245b5c3eb5dfcfcfc38/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.682521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cb343-cdc0-4ade-af13-3707f91f29b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b1ee1a01399487cad96a2b05411b445, user_id=d79845c2b5af4245b5c3eb5dfcfcfc38, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.685157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539cb343-cdc0-4ade-af13-3707f91f29b9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.698237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 955/1873] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:30 2022] PUT /identity/v3/projects/6b1ee1a01399487cad96a2b05411b445/users/d79845c2b5af4245b5c3eb5dfcfcfc38/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:30.708466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148bed9-b979-437e-9fd8-92574b3efc82 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.708867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148bed9-b979-437e-9fd8-92574b3efc82 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.709555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148bed9-b979-437e-9fd8-92574b3efc82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.737196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 919/1874] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:30 2022] PUT /identity/v3/projects/4c2af7cd7b834493b5be760e7ec1747f/users/478de02b1fe8404cac372e0409a95ce9/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:30.738429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.746112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:30.756538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4148bed9-b979-437e-9fd8-92574b3efc82 None None] MFA Rules not processed for user `d79845c2b5af4245b5c3eb5dfcfcfc38`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:30.758400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4148bed9-b979-437e-9fd8-92574b3efc82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:30.824351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6a4a02-79a5-4cba-a1da-1d1a26882801 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.829176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.829662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.829947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.830304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] PATH_INFO: `/v3/projects/1018ee66ee924350ab74d380d97c480f` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.834104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1018ee66ee924350ab74d380d97c480f)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.836598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.839664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 956/1875] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:30.841895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148bed9-b979-437e-9fd8-92574b3efc82 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.843881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:30.862743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148bed9-b979-437e-9fd8-92574b3efc82 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.868602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.869312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.869936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.870275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.871836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.873851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.885379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 957/1876] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:30 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:30.886286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.888971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:30.950542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77df697a-b3a7-4722-b965-f1d4576ca0b7 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.954287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.954928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.955212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.955489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.965586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:30.967068 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:30.976919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 958/1877] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:30.977736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:30.988603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55610b-32d3-4d2d-918d-69ee53a51d6d service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:30.993484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf6d82-ef65-4aba-a15d-2f81c0b6e39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:30.993814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf6d82-ef65-4aba-a15d-2f81c0b6e39e admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:30.994095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf6d82-ef65-4aba-a15d-2f81c0b6e39e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:30.994370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf6d82-ef65-4aba-a15d-2f81c0b6e39e admin admin] PATH_INFO: `/v3/projects/4c2af7cd7b834493b5be760e7ec1747f/users/478de02b1fe8404cac372e0409a95ce9/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:30.996428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf6d82-ef65-4aba-a15d-2f81c0b6e39e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2af7cd7b834493b5be760e7ec1747f, user_id=478de02b1fe8404cac372e0409a95ce9, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:31.000529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf6d82-ef65-4aba-a15d-2f81c0b6e39e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:31.012462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 959/1878] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:30 2022] PUT /identity/v3/projects/4c2af7cd7b834493b5be760e7ec1747f/users/478de02b1fe8404cac372e0409a95ce9/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:31.022963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c474c-3aeb-4381-a470-9b0e57d2dfa4 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.023187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c474c-3aeb-4381-a470-9b0e57d2dfa4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.023514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c474c-3aeb-4381-a470-9b0e57d2dfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.063367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5c0c474c-3aeb-4381-a470-9b0e57d2dfa4 None None] MFA Rules not processed for user `478de02b1fe8404cac372e0409a95ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:31.063475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1018ee66ee924350ab74d380d97c480f', 'request_id': 'req-094ad018-a868-44c4-9472-b57477908ed8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.063936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5c0c474c-3aeb-4381-a470-9b0e57d2dfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.067237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1018ee66ee924350ab74d380d97c480f', 'request_id': 'req-094ad018-a868-44c4-9472-b57477908ed8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.075437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1018ee66ee924350ab74d380d97c480f', 'request_id': 'req-094ad018-a868-44c4-9472-b57477908ed8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.155197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 960/1879] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:31.156573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c474c-3aeb-4381-a470-9b0e57d2dfa4 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:31.171539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] The token cache is being invalidate because project 1018ee66ee924350ab74d380d97c480f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:31.171914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.172718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.174964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 920/1880] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:30 2022] DELETE /identity/v3/projects/1018ee66ee924350ab74d380d97c480f => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:31.179390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:31.181639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.237353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c474c-3aeb-4381-a470-9b0e57d2dfa4 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:31.241404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:31.242116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.242513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.243016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.245518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.300170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094ad018-a868-44c4-9472-b57477908ed8 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:31.306569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:31.307445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.309220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.309220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] PATH_INFO: `/v3/users/3bdb2c287263407989c6c1b422d284b8` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.309220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdb2c287263407989c6c1b422d284b8)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:31.311016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:31.311258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:31.312461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:31.322801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 961/1881] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:31 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:31.323261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:31.324758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.337954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c8b72e-5806-4d64-8770-046e45b54a18 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:31.342225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:31.342867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.343152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.343425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.345250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.361385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:31.362974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:31.374544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 962/1882] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:31.383714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:31.385218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.398698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c2d394-ea57-482c-81d3-e35baf75bd31 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:31.405625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:31.406366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.406669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.410746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] PATH_INFO: `/v3/users/adfe5135a83246718dfe93a86581ca0d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.410746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfe5135a83246718dfe93a86581ca0d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:31.410746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:31.545362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdb2c287263407989c6c1b422d284b8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.546037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdb2c287263407989c6c1b422d284b8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.601641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdb2c287263407989c6c1b422d284b8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.622217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfe5135a83246718dfe93a86581ca0d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.624054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdb2c287263407989c6c1b422d284b8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.625452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfe5135a83246718dfe93a86581ca0d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.632030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdb2c287263407989c6c1b422d284b8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.638345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 921/1883] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:31 2022] DELETE /identity/v3/users/3bdb2c287263407989c6c1b422d284b8 => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:31.639288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:31.640745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.703290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5347d1-0ee1-41e7-adea-8f9ce373ccc1 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:31.707952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:31.708610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.708891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.709165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.712356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.720024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfe5135a83246718dfe93a86581ca0d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.731239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfe5135a83246718dfe93a86581ca0d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.748135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-218cdce8-9450-40e1-8966-e6c42a4f4b7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfe5135a83246718dfe93a86581ca0d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:31.755105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 963/1884] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:31 2022] DELETE /identity/v3/users/adfe5135a83246718dfe93a86581ca0d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:31.759396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.759772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.760100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.778863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:31.780157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.781467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:31.782950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:31.794994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 922/1885] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:31.844684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 964/1886] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:31.854614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:31.858039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:31.916022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd50d4-5528-46e5-80da-5ec5485cb8b3 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:31.970486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0913a4f-fb2e-4cb1-9d55-efca2d096631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:31.971139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913a4f-fb2e-4cb1-9d55-efca2d096631 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:31.977325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913a4f-fb2e-4cb1-9d55-efca2d096631 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:31.977325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0913a4f-fb2e-4cb1-9d55-efca2d096631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:31.981978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913a4f-fb2e-4cb1-9d55-efca2d096631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:31.983456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0913a4f-fb2e-4cb1-9d55-efca2d096631 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:31.994103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 923/1887] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:32.120507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:32.121952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:32.135511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138a2002-f3ee-4d50-abc0-93097ca1c804 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:32.142325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:32.143063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:32.147513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:32.147513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] PATH_INFO: `/v3/projects/52994b4910c24529b1179a0de3db91ee` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:32.147513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52994b4910c24529b1179a0de3db91ee)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:32.149225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:32.240424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:32.333145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52994b4910c24529b1179a0de3db91ee', 'request_id': 'req-de62ad92-a27d-4f86-822f-1c41303166a2'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.356080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52994b4910c24529b1179a0de3db91ee', 'request_id': 'req-de62ad92-a27d-4f86-822f-1c41303166a2'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.497188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52994b4910c24529b1179a0de3db91ee', 'request_id': 'req-de62ad92-a27d-4f86-822f-1c41303166a2'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.519230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] The token cache is being invalidate because project 52994b4910c24529b1179a0de3db91ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:32.519726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.520554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de62ad92-a27d-4f86-822f-1c41303166a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.524017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 965/1888] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:32 2022] DELETE /identity/v3/projects/52994b4910c24529b1179a0de3db91ee => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:32.530613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d847f8-ae2e-4de7-af7b-a1bdbdb3e55e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:32.534815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d847f8-ae2e-4de7-af7b-a1bdbdb3e55e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:32.534815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d847f8-ae2e-4de7-af7b-a1bdbdb3e55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:32.556606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-02d847f8-ae2e-4de7-af7b-a1bdbdb3e55e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:32.558990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-02d847f8-ae2e-4de7-af7b-a1bdbdb3e55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:32.634058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 924/1889] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:32.642264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed6fc-5451-454a-940f-5f1199b6e3dc None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:32.642847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed6fc-5451-454a-940f-5f1199b6e3dc None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:32.642952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3ed6fc-5451-454a-940f-5f1199b6e3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:32.673921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ba3ed6fc-5451-454a-940f-5f1199b6e3dc None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:32.675852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ba3ed6fc-5451-454a-940f-5f1199b6e3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:32.690388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 966/1890] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:32.694405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d847f8-ae2e-4de7-af7b-a1bdbdb3e55e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:32.705027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d847f8-ae2e-4de7-af7b-a1bdbdb3e55e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:32.716661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:32.717420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:32.717773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:32.718271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:32.719057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:32.719376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:32.721007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:32.738076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 925/1891] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:32.739407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed6fc-5451-454a-940f-5f1199b6e3dc None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:32.749755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3ed6fc-5451-454a-940f-5f1199b6e3dc None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:32.754588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:32.755225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:32.758332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:32.758332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:32.758332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:32.758332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:32.785211 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:32.787185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:32.801039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3d32ce-6e98-4ea3-910e-6d65461356d2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:32.806655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:32.807417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:32.807698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:32.807976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] PATH_INFO: `/v3/projects/a2622b51158145da9958b05cf9d93a62` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:32.809103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2622b51158145da9958b05cf9d93a62)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:32.811110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:32.870331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 967/1892] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:32 2022] POST /identity/v3/projects => generated 385 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:32.874290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:32.937581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3693a-7804-4d05-bd38-e7b380b64204 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:32.937784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2622b51158145da9958b05cf9d93a62', 'request_id': 'req-2177edd8-a0b4-4ea5-b327-0602ed918e9b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.944569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2622b51158145da9958b05cf9d93a62', 'request_id': 'req-2177edd8-a0b4-4ea5-b327-0602ed918e9b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.950996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2622b51158145da9958b05cf9d93a62', 'request_id': 'req-2177edd8-a0b4-4ea5-b327-0602ed918e9b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:32.996367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:32.996990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:32.997273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:32.997674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:32.998234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:33.000276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:33.022751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] The token cache is being invalidate because project a2622b51158145da9958b05cf9d93a62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:33.023076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:33.023798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:33.025603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 926/1893] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:32 2022] DELETE /identity/v3/projects/a2622b51158145da9958b05cf9d93a62 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:33.029735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:33.031131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:33.044786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2177edd8-a0b4-4ea5-b327-0602ed918e9b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:33.049611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:33.050238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:33.050523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:33.050831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] PATH_INFO: `/v3/users/d4b0dd98070844daae54047108826297` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:33.052050 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4b0dd98070844daae54047108826297)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:33.053988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:33.078519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 968/1894] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:32 2022] POST /identity/v3/users => generated 293 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:33.079972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:33.081685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:33.094513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7297eec2-7df4-47af-b630-70844dc39dd7 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:33.099254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:33.104626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:33.104626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:33.104626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:33.104626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:33.104626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:33.113154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 969/1895] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:33.117015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:33.126383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02f6d44-8656-4732-bef0-8d90dbdb538c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:33.131236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:33.131857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:33.132144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:33.132418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:33.133057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:33.134707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:33.145250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 970/1896] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:33.149776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:33.159505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b135f5-584a-4bbb-8050-90853b415198 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:33.164858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2568af4-68fd-4729-81f8-c2e0e0d4fd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:33.165545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568af4-68fd-4729-81f8-c2e0e0d4fd75 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:33.165782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568af4-68fd-4729-81f8-c2e0e0d4fd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:33.166477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2568af4-68fd-4729-81f8-c2e0e0d4fd75 admin admin] PATH_INFO: `/v3/projects/d0ba16bc031d446bbca9cb8fdc74b985/users/fef9d26a267441839ba6be9d5f8ef6fa/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:33.181480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2568af4-68fd-4729-81f8-c2e0e0d4fd75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0ba16bc031d446bbca9cb8fdc74b985, user_id=fef9d26a267441839ba6be9d5f8ef6fa, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:33.185075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2568af4-68fd-4729-81f8-c2e0e0d4fd75 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:33.294246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:33.294967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4b0dd98070844daae54047108826297'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:33.295838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4b0dd98070844daae54047108826297'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:33.303184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 971/1897] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:33 2022] PUT /identity/v3/projects/d0ba16bc031d446bbca9cb8fdc74b985/users/fef9d26a267441839ba6be9d5f8ef6fa/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:33.313813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8ee4f-1887-47ea-940b-6e8f2c7d5e61 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:33.314177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8ee4f-1887-47ea-940b-6e8f2c7d5e61 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:33.315436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c8ee4f-1887-47ea-940b-6e8f2c7d5e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:33.346608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-57c8ee4f-1887-47ea-940b-6e8f2c7d5e61 None None] MFA Rules not processed for user `fef9d26a267441839ba6be9d5f8ef6fa`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:33.347757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-57c8ee4f-1887-47ea-940b-6e8f2c7d5e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:33.376826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4b0dd98070844daae54047108826297'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:33.391821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4b0dd98070844daae54047108826297'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:33.401860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4b0dd98070844daae54047108826297'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:33.410346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 927/1898] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:33 2022] DELETE /identity/v3/users/d4b0dd98070844daae54047108826297 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:33.425434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 972/1899] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:33.427871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:33.429519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:33.531778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b704fc7-5baf-4f44-9fd0-dc05ddecb956 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:33.540498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:33.541172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:33.543386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:33.543386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:33.543386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:33.544462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:33.675033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 928/1900] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:33 2022] POST /identity/v3/projects => generated 387 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:33.679354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8ee4f-1887-47ea-940b-6e8f2c7d5e61 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:33.797419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c8ee4f-1887-47ea-940b-6e8f2c7d5e61 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:33.880914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:33.882921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:33.883277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:33.883660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:33.884585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:33.887309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.094116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.095973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:34.098598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 973/1901] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:33 2022] POST /identity/v3/users => generated 300 bytes in 420 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:34.104054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.115499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b937f5b-20b1-4c6f-a136-bc5e77fbe94b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.119378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f1bc19-0fb8-4757-ab83-40be503db0f8 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.121479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.122038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.122497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.122975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.123126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.123557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] PATH_INFO: `/v3/projects/747545ac63274ad8ab9260977887dbe2` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.123720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.124051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.124816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.125628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=747545ac63274ad8ab9260977887dbe2)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.126566 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.127920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.138355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:34.148589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 974/1902] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:34.148589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.159902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d575746d-5a1f-408f-a8df-32848ee70dba admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.165787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.166474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.166801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.167070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] PATH_INFO: `/v3/projects/98ce5247c1df468bbcefeff6cf426f09/users/f8f71c22af724861b2e31dbc13c42e16/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.185829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ce5247c1df468bbcefeff6cf426f09, user_id=f8f71c22af724861b2e31dbc13c42e16, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.188139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.288792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 975/1903] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:34 2022] PUT /identity/v3/projects/98ce5247c1df468bbcefeff6cf426f09/users/f8f71c22af724861b2e31dbc13c42e16/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:34.297662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '747545ac63274ad8ab9260977887dbe2', 'request_id': 'req-3d73bbee-421a-4d4e-832a-da7830927027'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:34.299751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.305278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '747545ac63274ad8ab9260977887dbe2', 'request_id': 'req-3d73bbee-421a-4d4e-832a-da7830927027'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:34.313093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '747545ac63274ad8ab9260977887dbe2', 'request_id': 'req-3d73bbee-421a-4d4e-832a-da7830927027'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:34.378292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430205b4-5ea5-410d-882a-1a35b8bf9387 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.385289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.385289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.385289 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.385564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.386206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.387866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.398669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 976/1904] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:34.403394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.413988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09892a2d-a60a-40bf-9854-a67f67ffbf82 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.419022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907d195e-42bc-4a9d-a0a4-370252b4cbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.419829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d195e-42bc-4a9d-a0a4-370252b4cbab admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.420180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d195e-42bc-4a9d-a0a4-370252b4cbab admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.420470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907d195e-42bc-4a9d-a0a4-370252b4cbab admin admin] PATH_INFO: `/v3/projects/98ce5247c1df468bbcefeff6cf426f09/users/f8f71c22af724861b2e31dbc13c42e16/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.422599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d195e-42bc-4a9d-a0a4-370252b4cbab admin admin] RBAC: Authorizing `identity:create_grant(project_id=98ce5247c1df468bbcefeff6cf426f09, user_id=f8f71c22af724861b2e31dbc13c42e16, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.425504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907d195e-42bc-4a9d-a0a4-370252b4cbab admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.436488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 977/1905] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:34 2022] PUT /identity/v3/projects/98ce5247c1df468bbcefeff6cf426f09/users/f8f71c22af724861b2e31dbc13c42e16/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:34.438735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] The token cache is being invalidate because project 747545ac63274ad8ab9260977887dbe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:34.439073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:34.446246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3d73bbee-421a-4d4e-832a-da7830927027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:34.446246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 929/1906] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:34 2022] DELETE /identity/v3/projects/747545ac63274ad8ab9260977887dbe2 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:34.450706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521501-6fab-4f87-af16-f928c2175360 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.450969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521501-6fab-4f87-af16-f928c2175360 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.451298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06521501-6fab-4f87-af16-f928c2175360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.455940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2144ca-18b4-4c0d-b53f-4319156cd06f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.456228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2144ca-18b4-4c0d-b53f-4319156cd06f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.456503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2144ca-18b4-4c0d-b53f-4319156cd06f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.472540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-06521501-6fab-4f87-af16-f928c2175360 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:34.473887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-06521501-6fab-4f87-af16-f928c2175360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:34.490330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ca2144ca-18b4-4c0d-b53f-4319156cd06f None None] MFA Rules not processed for user `f8f71c22af724861b2e31dbc13c42e16`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:34.491916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ca2144ca-18b4-4c0d-b53f-4319156cd06f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:34.538462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 978/1907] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:34.546601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.546929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.547212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.568324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:34.569638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:34.576259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 930/1908] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:34.580834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 979/1909] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:34.585579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2144ca-18b4-4c0d-b53f-4319156cd06f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.596389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2144ca-18b4-4c0d-b53f-4319156cd06f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.603456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.604403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.604616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.604904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.605574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:34.605992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.607557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.615300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.616852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:34.626964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 931/1910] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:34.636102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.649693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3165318a-6e8d-4244-91ee-6546ce63bb02 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.657479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.660477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.660477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.660477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.660477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.663403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.703798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb5db09-99b3-4b6e-ac1c-9869e14cec41 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.708051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.708629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.708914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.711938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.729749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.731272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.743451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 980/1911] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:34.773562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.775396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:34.790812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 932/1912] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:34 2022] POST /identity/v3/projects => generated 383 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:34.794311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6c7d5d-3297-4e86-85b4-334624cc3dd3 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.797400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:34.857710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.858429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.858864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.859212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] PATH_INFO: `/v3/users/fef9d26a267441839ba6be9d5f8ef6fa` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.860624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fef9d26a267441839ba6be9d5f8ef6fa)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.862963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.869426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fe631-6fa2-42e9-abcd-a90e467144c2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:34.874490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:34.875146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:34.875436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:34.875733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:34.876437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:34.878493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:34.992247 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 933/1913] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:34 2022] POST /identity/v3/users => generated 292 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:34.996874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:35.009204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f33b5b-762f-4d7f-a286-ea7a2f5550a3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:35.015690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:35.018268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.018268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.018268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.018268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:35.020697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:35.034826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 934/1914] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:34 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:35.039125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:35.051112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd86081-a080-468f-8065-e563f3352745 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:35.057351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:35.058390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.058892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.059389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.060225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:35.062329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:35.075807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 935/1915] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:35.076048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fef9d26a267441839ba6be9d5f8ef6fa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:35.076552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fef9d26a267441839ba6be9d5f8ef6fa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:35.079672 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:35.081979 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:35.095953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf138d3-4b18-4871-ae55-992322a661d2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:35.096310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:35.102622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b60921-d0ef-4371-befe-1106c9b15ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:35.103604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b60921-d0ef-4371-befe-1106c9b15ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.103890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b60921-d0ef-4371-befe-1106c9b15ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.105748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b60921-d0ef-4371-befe-1106c9b15ad6 admin admin] PATH_INFO: `/v3/projects/7056a3a01fc24769928892504108efa6/users/29c91d7d94614082ab0db41c41d718ae/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.136191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b60921-d0ef-4371-befe-1106c9b15ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7056a3a01fc24769928892504108efa6, user_id=29c91d7d94614082ab0db41c41d718ae, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:35.136191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b60921-d0ef-4371-befe-1106c9b15ad6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:35.165447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fef9d26a267441839ba6be9d5f8ef6fa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:35.173259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fef9d26a267441839ba6be9d5f8ef6fa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:35.186274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-18cd9b7a-21b3-4d08-b784-d2d2272523d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fef9d26a267441839ba6be9d5f8ef6fa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:35.192635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 981/1916] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:34 2022] DELETE /identity/v3/users/fef9d26a267441839ba6be9d5f8ef6fa => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:35.197795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.198157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.198571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.219330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:35.220570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:35.270901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 936/1917] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:35 2022] PUT /identity/v3/projects/7056a3a01fc24769928892504108efa6/users/29c91d7d94614082ab0db41c41d718ae/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:35.288883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.289330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.296495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.303931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 982/1918] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:35.313600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:35.315208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:35.328499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] MFA Rules not processed for user `29c91d7d94614082ab0db41c41d718ae`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:35.329894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:35.384899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1f69f-a2cb-43e3-8166-d2329219b575 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:35.407556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 937/1919] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:35.419514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:35.420945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:35.450407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:35.451646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.451931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.452203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.486146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4f8db-af9e-4afa-abf6-2045e96c14df None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:35.489860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:35.490380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.491250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.491530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.500096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:35.501531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:35.510722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 938/1920] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:58:35.520226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:35.521709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:35.532443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 983/1921] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:58:35.685919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:35.936091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:35.937674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:35.967381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031f4f9-66d5-4f0d-8091-ca22d8d335b3 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:35.973744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:35.974541 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:35.975571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:35.975861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] PATH_INFO: `/v3/projects/d0ba16bc031d446bbca9cb8fdc74b985` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:35.977147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0ba16bc031d446bbca9cb8fdc74b985)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:35.979383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:36.111410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0ba16bc031d446bbca9cb8fdc74b985', 'request_id': 'req-63d30d6d-ad16-4b1c-9010-55b41cf0267b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.117683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0ba16bc031d446bbca9cb8fdc74b985', 'request_id': 'req-63d30d6d-ad16-4b1c-9010-55b41cf0267b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.123395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0ba16bc031d446bbca9cb8fdc74b985', 'request_id': 'req-63d30d6d-ad16-4b1c-9010-55b41cf0267b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.217629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] The token cache is being invalidate because project d0ba16bc031d446bbca9cb8fdc74b985 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:36.221672 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.223773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.226264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 939/1922] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:35 2022] DELETE /identity/v3/projects/d0ba16bc031d446bbca9cb8fdc74b985 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:36.231156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:36.248859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6950ae35-3aba-446f-8cf4-0ebc796bb018 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:36.319236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:36.319236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:36.319236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:36.319525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] PATH_INFO: `/v3/users/f8f71c22af724861b2e31dbc13c42e16` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:36.320645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8f71c22af724861b2e31dbc13c42e16)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:36.322570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:36.543942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:36.546131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:36.555917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8f71c22af724861b2e31dbc13c42e16'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.556657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8f71c22af724861b2e31dbc13c42e16'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.565526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d30d6d-ad16-4b1c-9010-55b41cf0267b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:36.571555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:36.572209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:36.572492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:36.572769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] PATH_INFO: `/v3/users/69a52cb497584e338d2220a3402df44c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:36.574257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=69a52cb497584e338d2220a3402df44c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:36.576276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:36.676981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:36.678904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8f71c22af724861b2e31dbc13c42e16'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.697486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8f71c22af724861b2e31dbc13c42e16'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.705830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69da5f41-31cb-4c5c-9f12-f855d8ed74bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8f71c22af724861b2e31dbc13c42e16'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.722431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 984/1923] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:36 2022] DELETE /identity/v3/users/f8f71c22af724861b2e31dbc13c42e16 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:36.832366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69a52cb497584e338d2220a3402df44c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.833067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69a52cb497584e338d2220a3402df44c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.936503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69a52cb497584e338d2220a3402df44c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.957741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69a52cb497584e338d2220a3402df44c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.967435 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69a52cb497584e338d2220a3402df44c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:36.977941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 940/1924] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:36 2022] DELETE /identity/v3/users/69a52cb497584e338d2220a3402df44c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:36.982292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:36.982713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:36.983128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.011731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:37.013920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.098795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 985/1925] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:37.109533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:37.111497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.173542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602ab753-ec9a-4b16-83e4-c79c0eef35cd admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:37.177081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:37.185756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:37.186995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25710a9a-8fb0-4f9c-9afe-9098d31227c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:37.187340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.188030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710a9a-8fb0-4f9c-9afe-9098d31227c8 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.188787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710a9a-8fb0-4f9c-9afe-9098d31227c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.188899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25710a9a-8fb0-4f9c-9afe-9098d31227c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.200722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25710a9a-8fb0-4f9c-9afe-9098d31227c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:37.202401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25710a9a-8fb0-4f9c-9afe-9098d31227c8 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:37.209586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc25dc-3fa4-4a5f-bf2b-803413a9e3f0 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:37.213685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 941/1926] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:37.215658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466f29-3eb3-4dba-be99-deca20381d19 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.216204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466f29-3eb3-4dba-be99-deca20381d19 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.216494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c466f29-3eb3-4dba-be99-deca20381d19 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.217846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 942/1927] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 06:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:58:37.220500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:37.221240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.221589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.221869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] PATH_INFO: `/v3/projects/98ce5247c1df468bbcefeff6cf426f09` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.223155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98ce5247c1df468bbcefeff6cf426f09)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:37.226073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:37.245095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.246742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.247174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.289058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:37.291492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.385168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 943/1928] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 06:58:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:37.407008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:37.408632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.469530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72afc702-f83a-4fa4-b254-c60153dda636 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:37.472756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98ce5247c1df468bbcefeff6cf426f09', 'request_id': 'req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:37.502309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98ce5247c1df468bbcefeff6cf426f09', 'request_id': 'req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:37.634578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffbcb55-2957-4e4c-beaf-e9de2a085799 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:37.635404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbcb55-2957-4e4c-beaf-e9de2a085799 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.635819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbcb55-2957-4e4c-beaf-e9de2a085799 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.637263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffbcb55-2957-4e4c-beaf-e9de2a085799 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.652923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbcb55-2957-4e4c-beaf-e9de2a085799 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:37.653404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98ce5247c1df468bbcefeff6cf426f09', 'request_id': 'req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:37.654866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffbcb55-2957-4e4c-beaf-e9de2a085799 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:37.670492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] The token cache is being invalidate because project 98ce5247c1df468bbcefeff6cf426f09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:37.671167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:37.675388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a05d5a8e-b60d-4533-8bb6-6b7fd6b69df8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:37.677674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 986/1929] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:37 2022] DELETE /identity/v3/projects/98ce5247c1df468bbcefeff6cf426f09 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:37.683718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.684197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.684623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.691172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 944/1930] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:37.722527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:37.724754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.858339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 987/1931] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:37.860129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16367ec-abe8-4505-aa14-f3e771d9e029 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.866566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16367ec-abe8-4505-aa14-f3e771d9e029 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.866566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16367ec-abe8-4505-aa14-f3e771d9e029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.899421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b16367ec-abe8-4505-aa14-f3e771d9e029 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:37.900803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b16367ec-abe8-4505-aa14-f3e771d9e029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.902177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:37.907918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:37.938245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 945/1932] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:37.947886 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc7b288-4ec6-4c71-97b1-c4315098a493 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:37.952144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16367ec-abe8-4505-aa14-f3e771d9e029 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:37.958660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:37.960041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.960468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.960695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] PATH_INFO: `/v3/projects/22985891170d452887df72fad4f6d43c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.962555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22985891170d452887df72fad4f6d43c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:37.966690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:37.967518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16367ec-abe8-4505-aa14-f3e771d9e029 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:37.980254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:37.981241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:37.981660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:37.982458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:37.983328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:37.985131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:37.989870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.020624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 946/1933] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:38.025898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.043147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74c1643-d207-46e2-9a28-8d558aa55ff3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:38.050410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:38.051060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.051336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.051618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.052258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:38.055551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.204683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22985891170d452887df72fad4f6d43c', 'request_id': 'req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.211200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22985891170d452887df72fad4f6d43c', 'request_id': 'req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.248792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 947/1934] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:38 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:38.252708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.313396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22985891170d452887df72fad4f6d43c', 'request_id': 'req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.327452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] The token cache is being invalidate because project 22985891170d452887df72fad4f6d43c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:38.328104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.328922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.330822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 988/1935] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:37 2022] DELETE /identity/v3/projects/22985891170d452887df72fad4f6d43c => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:38.337467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.337652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa2fd5-fca3-4708-9355-2be06ac4a734 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:38.339475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:38.344180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:38.347691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.347691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.347691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.347691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:38.348883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.426679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e130a7d3-5dbb-4abb-bb72-b10620fdd8c8 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:38.433466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:38.434116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.434570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.435037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] PATH_INFO: `/v3/users/87ba8fffabfb49ec9af9d6b50eef790f` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.436581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=87ba8fffabfb49ec9af9d6b50eef790f)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:38.438540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.462752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 948/1936] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:38 2022] POST /identity/v3/users => generated 289 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:38.466824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.469375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:38.487733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b3e6e-c446-472d-a883-40dffc11c31f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:38.496301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:38.496674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.497780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.497780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.498523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:38.500398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.517619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 949/1937] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:38.519616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.532986 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120798c6-a2fa-41cd-9e8c-0cbd97ce6ab2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:38.542798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:38.543441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.543734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.544031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.544695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:38.551742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.565273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 950/1938] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:38 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:38.579126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.590221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d661d5-c109-424c-9d2a-9abea216a874 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:38.594997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009497d-191e-468b-ab57-76f6886f4573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:38.595666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009497d-191e-468b-ab57-76f6886f4573 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.595977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009497d-191e-468b-ab57-76f6886f4573 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.596258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009497d-191e-468b-ab57-76f6886f4573 admin admin] PATH_INFO: `/v3/projects/be745b8ac2b046bcadd752ea89049bd1/users/defde50e9dd54a87984fd06508e7fa7b/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.611033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009497d-191e-468b-ab57-76f6886f4573 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be745b8ac2b046bcadd752ea89049bd1, user_id=defde50e9dd54a87984fd06508e7fa7b, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:38.613707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009497d-191e-468b-ab57-76f6886f4573 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.688381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87ba8fffabfb49ec9af9d6b50eef790f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.689205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87ba8fffabfb49ec9af9d6b50eef790f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.754829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 951/1939] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:38 2022] PUT /identity/v3/projects/be745b8ac2b046bcadd752ea89049bd1/users/defde50e9dd54a87984fd06508e7fa7b/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:38.765800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.766093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.766373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.788230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87ba8fffabfb49ec9af9d6b50eef790f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.797065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87ba8fffabfb49ec9af9d6b50eef790f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.803638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] MFA Rules not processed for user `defde50e9dd54a87984fd06508e7fa7b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:38.804883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:38.814547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87ba8fffabfb49ec9af9d6b50eef790f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:38.822457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 989/1940] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:38 2022] DELETE /identity/v3/users/87ba8fffabfb49ec9af9d6b50eef790f => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:38.883324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 952/1941] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:38.887998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.889517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:38.960207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e01d7b-f601-4ffa-9e3a-4fc5a42986ec admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:38.965779 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:38.966554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:38.966874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:38.967273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:38.967927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:38.969981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:38.985164 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:38.987435 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.065919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4c6f80-a7cc-4f5f-ab27-7caec333c4dd None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.072784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.073457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.073866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.074206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] PATH_INFO: `/v3/users/29c91d7d94614082ab0db41c41d718ae` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.076088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29c91d7d94614082ab0db41c41d718ae)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.078611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:39.078928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 990/1942] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:38 2022] POST /identity/v3/projects => generated 379 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:39.083879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.209966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75509652-b599-4fa0-9470-ae95972c590a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.215668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.216429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.216958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.217303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.218467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.220397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:39.246655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:39.360664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29c91d7d94614082ab0db41c41d718ae'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.361258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29c91d7d94614082ab0db41c41d718ae'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.415311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 991/1943] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:39 2022] POST /identity/v3/users => generated 296 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:39.418188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.420453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.432440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29c91d7d94614082ab0db41c41d718ae'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.447904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29c91d7d94614082ab0db41c41d718ae'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.448189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f74f99-4cd4-4deb-90f7-852c1d619cad admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.458732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29c91d7d94614082ab0db41c41d718ae'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.466293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 953/1944] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:38 2022] DELETE /identity/v3/users/29c91d7d94614082ab0db41c41d718ae => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:39.467558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.469717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.478029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.479206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.479830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.486965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] PATH_INFO: `/v3/projects/23b36b80178f47dbb53ef713c4a57191` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.486965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23b36b80178f47dbb53ef713c4a57191)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.486965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:39.561724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18e967-d731-4a2d-a149-3d93e78793c0 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.561724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c5644-a091-4646-a509-779cf906cfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.561724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5644-a091-4646-a509-779cf906cfc0 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.561724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5644-a091-4646-a509-779cf906cfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.562816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c5644-a091-4646-a509-779cf906cfc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.562816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5644-a091-4646-a509-779cf906cfc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.562816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c5644-a091-4646-a509-779cf906cfc0 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:39.567114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 954/1945] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:39.568635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fa9ce-cd25-4abb-a21b-439ae7646dc2 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.568963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fa9ce-cd25-4abb-a21b-439ae7646dc2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.569239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379fa9ce-cd25-4abb-a21b-439ae7646dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.595551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-379fa9ce-cd25-4abb-a21b-439ae7646dc2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:39.597033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-379fa9ce-cd25-4abb-a21b-439ae7646dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.606237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 955/1946] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:39.610386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fa9ce-cd25-4abb-a21b-439ae7646dc2 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.623741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379fa9ce-cd25-4abb-a21b-439ae7646dc2 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.629484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.630290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.630750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.631626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] PATH_INFO: `/v3/projects/66f8e1b4c2c841cebce9fc6a7079a370/users/b8b663d199b94d398ecb6001af7df827/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.652914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f8e1b4c2c841cebce9fc6a7079a370, user_id=b8b663d199b94d398ecb6001af7df827, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.656077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:39.731409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 956/1947] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:39 2022] PUT /identity/v3/projects/66f8e1b4c2c841cebce9fc6a7079a370/users/b8b663d199b94d398ecb6001af7df827/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:39.735309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.735309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.741999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23b36b80178f47dbb53ef713c4a57191', 'request_id': 'req-0bcf5a49-a177-4eda-a357-bc38194b0107'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.749044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23b36b80178f47dbb53ef713c4a57191', 'request_id': 'req-0bcf5a49-a177-4eda-a357-bc38194b0107'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.796709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760cdec1-c15c-4993-bda8-46eeed8e4ebc admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.832637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23b36b80178f47dbb53ef713c4a57191', 'request_id': 'req-0bcf5a49-a177-4eda-a357-bc38194b0107'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.846810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] The token cache is being invalidate because project 23b36b80178f47dbb53ef713c4a57191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:39.847966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.848820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:39.851565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 992/1948] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:39 2022] DELETE /identity/v3/projects/23b36b80178f47dbb53ef713c4a57191 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:39.852185 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.852821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.852927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.853105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.853386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.854910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.856346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.871961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:39.950247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf5a49-a177-4eda-a357-bc38194b0107 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.951142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.953107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:39.955738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.956460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.956816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.957148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.957863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.960313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:39.965068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 957/1949] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:39.965956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.967436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:39.978329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 993/1950] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:39 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:39.981506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:39.983261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d91ff9-8860-44ec-bfda-688e729e4d1a service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:39.988581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:39.989301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:39.989591 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:39.989873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] PATH_INFO: `/v3/users/d79845c2b5af4245b5c3eb5dfcfcfc38` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:39.992029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d79845c2b5af4245b5c3eb5dfcfcfc38)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:39.994221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:40.003887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016b450-c48c-4bd5-b2c1-da5239c8f213 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:40.018726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da1c583-f313-47be-9b07-c8aa766d161d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:40.019601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1c583-f313-47be-9b07-c8aa766d161d admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:40.019893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1c583-f313-47be-9b07-c8aa766d161d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:40.020384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da1c583-f313-47be-9b07-c8aa766d161d admin admin] PATH_INFO: `/v3/projects/66f8e1b4c2c841cebce9fc6a7079a370/users/b8b663d199b94d398ecb6001af7df827/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:40.026575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1c583-f313-47be-9b07-c8aa766d161d admin admin] RBAC: Authorizing `identity:create_grant(project_id=66f8e1b4c2c841cebce9fc6a7079a370, user_id=b8b663d199b94d398ecb6001af7df827, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:40.033235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da1c583-f313-47be-9b07-c8aa766d161d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:40.055197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 994/1951] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:39 2022] PUT /identity/v3/projects/66f8e1b4c2c841cebce9fc6a7079a370/users/b8b663d199b94d398ecb6001af7df827/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:40.071516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:40.072098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:40.072557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:40.109059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] MFA Rules not processed for user `b8b663d199b94d398ecb6001af7df827`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:40.111455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:40.211252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 995/1952] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:40.223798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:40.225711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:40.285557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2cfa83-eb0d-4620-b27b-29565d086568 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:40.291503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:40.292134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:40.292420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:40.292700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:40.294541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:40.342536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd79845c2b5af4245b5c3eb5dfcfcfc38'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:40.343303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd79845c2b5af4245b5c3eb5dfcfcfc38'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:40.398822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:40.398822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:40.409972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 996/1953] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:40 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:40.444100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd79845c2b5af4245b5c3eb5dfcfcfc38'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:40.462999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd79845c2b5af4245b5c3eb5dfcfcfc38'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:40.470205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd79845c2b5af4245b5c3eb5dfcfcfc38'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:40.478214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 958/1954] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:39 2022] DELETE /identity/v3/users/d79845c2b5af4245b5c3eb5dfcfcfc38 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:40.731859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:40.733518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:40.822627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08aa0ff-c9f7-45c1-b068-ace0b3e92874 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:40.890522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:40.891203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:40.891488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:40.891766 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] PATH_INFO: `/v3/projects/7056a3a01fc24769928892504108efa6` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:40.892905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7056a3a01fc24769928892504108efa6)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:40.895075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.055756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7056a3a01fc24769928892504108efa6', 'request_id': 'req-f59eee6f-797e-41f6-9962-28e2427537a7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.061044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7056a3a01fc24769928892504108efa6', 'request_id': 'req-f59eee6f-797e-41f6-9962-28e2427537a7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.119381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7056a3a01fc24769928892504108efa6', 'request_id': 'req-f59eee6f-797e-41f6-9962-28e2427537a7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.122211 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:41.129813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.129813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:41.143750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] The token cache is being invalidate because project 7056a3a01fc24769928892504108efa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:41.144185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.144874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f59eee6f-797e-41f6-9962-28e2427537a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.150206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 997/1955] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:40 2022] DELETE /identity/v3/projects/7056a3a01fc24769928892504108efa6 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:41.150484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081dff7d-1ed5-4aab-b813-79533024f9a9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.163798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f3e1-4a51-45fc-860c-1cbf98ea91d1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.163798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f3e1-4a51-45fc-860c-1cbf98ea91d1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.163798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e7f3e1-4a51-45fc-860c-1cbf98ea91d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.179928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c2e7f3e1-4a51-45fc-860c-1cbf98ea91d1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:41.181159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c2e7f3e1-4a51-45fc-860c-1cbf98ea91d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:41.224168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.224983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.225278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.225563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] PATH_INFO: `/v3/projects/6b1ee1a01399487cad96a2b05411b445` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.226782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b1ee1a01399487cad96a2b05411b445)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:41.228776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.257039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 998/1956] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:41.259179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5630b-3438-4ddf-b8c7-14219b0eab9a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.259486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5630b-3438-4ddf-b8c7-14219b0eab9a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.259787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c5630b-3438-4ddf-b8c7-14219b0eab9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.288164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c9c5630b-3438-4ddf-b8c7-14219b0eab9a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:41.289969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c9c5630b-3438-4ddf-b8c7-14219b0eab9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:41.300406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 999/1957] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:41.310867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5630b-3438-4ddf-b8c7-14219b0eab9a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.322483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c5630b-3438-4ddf-b8c7-14219b0eab9a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.327650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.328294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.328578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.329322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.335596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:41.335916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:41.338069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.361257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1000/1958] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:58:41.366860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.379987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13418987-e0af-4d92-b1a8-aeb5dab354fd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.383885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b1ee1a01399487cad96a2b05411b445', 'request_id': 'req-5cb89a01-7648-4309-9d84-6069eaa1bf64'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.394665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b1ee1a01399487cad96a2b05411b445', 'request_id': 'req-5cb89a01-7648-4309-9d84-6069eaa1bf64'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.405036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b1ee1a01399487cad96a2b05411b445', 'request_id': 'req-5cb89a01-7648-4309-9d84-6069eaa1bf64'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.461892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.462514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.462880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.468943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.468943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:41.468943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.531130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] The token cache is being invalidate because project 6b1ee1a01399487cad96a2b05411b445 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:41.531432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.532142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5cb89a01-7648-4309-9d84-6069eaa1bf64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:41.533659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 959/1959] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:41 2022] DELETE /identity/v3/projects/6b1ee1a01399487cad96a2b05411b445 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:41.540977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63c079-74c7-4d22-9400-10c6aa155277 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.541290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63c079-74c7-4d22-9400-10c6aa155277 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.541672 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63c079-74c7-4d22-9400-10c6aa155277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.568098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-2b63c079-74c7-4d22-9400-10c6aa155277 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:41.569507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2b63c079-74c7-4d22-9400-10c6aa155277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:41.585791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 960/1960] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:41.587395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94be07-4ba1-4722-b4d2-0bed8e93746d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.587788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94be07-4ba1-4722-b4d2-0bed8e93746d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.588011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94be07-4ba1-4722-b4d2-0bed8e93746d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.623600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-5b94be07-4ba1-4722-b4d2-0bed8e93746d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:41.625507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5b94be07-4ba1-4722-b4d2-0bed8e93746d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:41.633691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1001/1961] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:41.635101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.640585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:41.644989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 961/1962] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:41.650990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94be07-4ba1-4722-b4d2-0bed8e93746d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.663566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94be07-4ba1-4722-b4d2-0bed8e93746d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.729140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221eea78-4c9f-455d-a22d-f51747dda12a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.742627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.743278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.743565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.745708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.745708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:41.747342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.759259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.760596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.760882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.761163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.761906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:41.762219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:41.764108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.777815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 962/1963] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:41.781951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.802197 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396b5d0d-9ffe-416a-92be-7a61f8f09902 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.807896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.808508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.808948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.809229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.809958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:41.814941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.891524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1002/1964] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:41.895546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.906409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbc57f4-3ca1-4428-bcfa-5314c04569be admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.911324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.912495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.912799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.913075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:41.913801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:41.915452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:41.922279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 963/1965] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:41.927821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1003/1966] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:41.930942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.932737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:41.943940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2bede3-c5d5-4782-8894-05b137ec75bd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.993692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72409f-b263-4b0b-b756-6ca7fa01b7a9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:41.998598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:41.999359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:41.999673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:41.999984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.000644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.002897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.005030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:42.005030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.005030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.005030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.005470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.007100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.021014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1004/1967] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:42.026249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:42.039018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b571ac8c-6cb0-4259-bbc4-45167e981219 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:42.045317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af25bb-1165-4fa1-957e-94e39d141766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:42.045317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af25bb-1165-4fa1-957e-94e39d141766 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.045317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af25bb-1165-4fa1-957e-94e39d141766 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.045317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af25bb-1165-4fa1-957e-94e39d141766 admin admin] PATH_INFO: `/v3/projects/87687e97495245ccbd1a4758757e4bf0/users/f9a224f37eaf4bfa9985f9064b860295/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.060824 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af25bb-1165-4fa1-957e-94e39d141766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87687e97495245ccbd1a4758757e4bf0, user_id=f9a224f37eaf4bfa9985f9064b860295, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.063646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af25bb-1165-4fa1-957e-94e39d141766 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.171339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 964/1968] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:41 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:42.175425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:42.185362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7edba89-a6ba-4801-b0b3-62762a915dee admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:42.189962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:42.190560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.190881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.191161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.191803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.193897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.204189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 965/1969] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:42.206149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1005/1970] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:42 2022] PUT /identity/v3/projects/87687e97495245ccbd1a4758757e4bf0/users/f9a224f37eaf4bfa9985f9064b860295/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:42.207953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:42.216826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.217115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.217394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.222486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a0075-29b6-4671-85c5-3c37200bcfe7 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:42.252080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] MFA Rules not processed for user `f9a224f37eaf4bfa9985f9064b860295`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:42.253329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:42.281657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:42.282273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.282607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.282883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.283631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.285341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.295371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 966/1971] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:42 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:42.299660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:42.309379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13288ad3-3eee-4e0a-aeb4-b9ccb4148834 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:42.314298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129f025d-74e1-4bad-844c-2df888362022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:42.315023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f025d-74e1-4bad-844c-2df888362022 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.315319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f025d-74e1-4bad-844c-2df888362022 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.315599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129f025d-74e1-4bad-844c-2df888362022 admin admin] PATH_INFO: `/v3/projects/1f8e4ec10b3446189b1afc1a899ff2c5/users/3f0f9338a12b4d23afc61218c5328e57/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.320828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1006/1972] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:42.331768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:42.331933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f025d-74e1-4bad-844c-2df888362022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8e4ec10b3446189b1afc1a899ff2c5, user_id=3f0f9338a12b4d23afc61218c5328e57, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.333143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:42.335288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129f025d-74e1-4bad-844c-2df888362022 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.403178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad920e1-a8d8-4330-87c7-5458c30f21d7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:42.404182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:42.405016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.405480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.406012 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.416003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.417846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.429048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1007/1973] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:58:42.430161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:42.432409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:42.442587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c018d3-2985-4814-bcae-f962a0a56b5e service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:42.447459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:42.448069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.448337 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.448606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.450474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:42.475494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 967/1974] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:42 2022] PUT /identity/v3/projects/1f8e4ec10b3446189b1afc1a899ff2c5/users/3f0f9338a12b4d23afc61218c5328e57/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:42.478536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c1ad-07e1-481f-929a-bcea94edb26b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:42.478933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c1ad-07e1-481f-929a-bcea94edb26b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:42.479585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f580c1ad-07e1-481f-929a-bcea94edb26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:42.518745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:42.520612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:42.534365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f580c1ad-07e1-481f-929a-bcea94edb26b None None] MFA Rules not processed for user `3f0f9338a12b4d23afc61218c5328e57`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:42.537432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f580c1ad-07e1-481f-929a-bcea94edb26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:42.538398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1008/1975] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:42.704244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:42.708074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 968/1976] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:42.930288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:42.939595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec57fded-5ee9-4627-aa3f-e38c5e480d2c service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:42.999526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7208860-3238-42f1-a4c4-bd90acd96d96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:43.000136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7208860-3238-42f1-a4c4-bd90acd96d96 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:43.000417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7208860-3238-42f1-a4c4-bd90acd96d96 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:43.000702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7208860-3238-42f1-a4c4-bd90acd96d96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:43.027284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7208860-3238-42f1-a4c4-bd90acd96d96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:43.027284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7208860-3238-42f1-a4c4-bd90acd96d96 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:43.031665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1009/1977] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:43.056171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580c1ad-07e1-481f-929a-bcea94edb26b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:43.074612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:43.132699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f580c1ad-07e1-481f-929a-bcea94edb26b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:43.137922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:43.138574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:43.138923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:43.139216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] PATH_INFO: `/v3/users/3f0f9338a12b4d23afc61218c5328e57` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:43.140350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f0f9338a12b4d23afc61218c5328e57)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:43.142328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:43.465708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f0f9338a12b4d23afc61218c5328e57'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:43.466422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f0f9338a12b4d23afc61218c5328e57'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:43.581848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f0f9338a12b4d23afc61218c5328e57'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:43.594994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f0f9338a12b4d23afc61218c5328e57'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:43.603089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f0f9338a12b4d23afc61218c5328e57'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:43.614579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 969/1978] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:43 2022] DELETE /identity/v3/users/3f0f9338a12b4d23afc61218c5328e57 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:43.629649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:43.629997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:43.630281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:43.652571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:43.653795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:43.715748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1010/1979] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:43.726001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:43.727456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:43.763763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:43.766299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:43.778551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60d18e3-af7a-4bd1-8547-72f86f455169 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:43.783471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:43.784143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:43.784424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:43.784726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] PATH_INFO: `/v3/users/a18879c6228342be82bea03da451915f` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:43.786255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a18879c6228342be82bea03da451915f)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:43.788531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:43.794196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7984b35e-3bff-48f0-96a2-9903ea89fa7c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:43.799385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d39ff38-5104-4a6e-a41b-148eb456a1bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:43.800080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39ff38-5104-4a6e-a41b-148eb456a1bf service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:43.804410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39ff38-5104-4a6e-a41b-148eb456a1bf service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:43.804706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d39ff38-5104-4a6e-a41b-148eb456a1bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:43.816841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39ff38-5104-4a6e-a41b-148eb456a1bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:43.819012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d39ff38-5104-4a6e-a41b-148eb456a1bf service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:43.829531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 970/1980] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:44.092956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a18879c6228342be82bea03da451915f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:44.093654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a18879c6228342be82bea03da451915f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:44.244861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a18879c6228342be82bea03da451915f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:44.253321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a18879c6228342be82bea03da451915f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:44.267835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a18879c6228342be82bea03da451915f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:44.274906 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1011/1981] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:43 2022] DELETE /identity/v3/users/a18879c6228342be82bea03da451915f => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:44.279851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ae7e-59a7-4991-ae96-4ac72f99cccd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:44.280307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ae7e-59a7-4991-ae96-4ac72f99cccd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:44.280656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6188ae7e-59a7-4991-ae96-4ac72f99cccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:44.304193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-6188ae7e-59a7-4991-ae96-4ac72f99cccd None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:44.305652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6188ae7e-59a7-4991-ae96-4ac72f99cccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:44.370711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 971/1982] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:44.381716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:44.383552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:44.473389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2aeb2-e0f3-4c69-b0ac-4e0b7e45a5d4 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:44.478743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:44.479437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:44.479727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:44.480025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:44.501347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:44.502958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:44.537805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1012/1983] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:44.624913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af381-3d79-4c2f-9279-4175990fda4a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:44.624913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af381-3d79-4c2f-9279-4175990fda4a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:44.624913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19af381-3d79-4c2f-9279-4175990fda4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:44.644135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b19af381-3d79-4c2f-9279-4175990fda4a None None] MFA Rules not processed for user `f9a224f37eaf4bfa9985f9064b860295`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:44.645532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b19af381-3d79-4c2f-9279-4175990fda4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:44.770273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 972/1984] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:44.858331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:44.860451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:44.875234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf77039-9f07-4461-91a5-981c755bbe57 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:44.881394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:44.882134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:44.882478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:44.882844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] PATH_INFO: `/v3/projects/1f8e4ec10b3446189b1afc1a899ff2c5` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:44.884440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8e4ec10b3446189b1afc1a899ff2c5)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:44.886700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.028548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:45.030152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8e4ec10b3446189b1afc1a899ff2c5', 'request_id': 'req-71956288-2b51-472f-840e-77bb58dd2b49'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.039848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8e4ec10b3446189b1afc1a899ff2c5', 'request_id': 'req-71956288-2b51-472f-840e-77bb58dd2b49'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.116905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8e4ec10b3446189b1afc1a899ff2c5', 'request_id': 'req-71956288-2b51-472f-840e-77bb58dd2b49'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.130790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] The token cache is being invalidate because project 1f8e4ec10b3446189b1afc1a899ff2c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:45.131091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.131827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-71956288-2b51-472f-840e-77bb58dd2b49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.136972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1013/1985] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:44 2022] DELETE /identity/v3/projects/1f8e4ec10b3446189b1afc1a899ff2c5 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:45.138608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97992a-d9f9-4d22-984c-1190cd9ef9cb None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.138932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97992a-d9f9-4d22-984c-1190cd9ef9cb None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.139493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f97992a-d9f9-4d22-984c-1190cd9ef9cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.162400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8f97992a-d9f9-4d22-984c-1190cd9ef9cb None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:45.163715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8f97992a-d9f9-4d22-984c-1190cd9ef9cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:45.248660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 973/1986] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:45.252442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145962-d04e-4d5a-b88e-2b3aa052203b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.252788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145962-d04e-4d5a-b88e-2b3aa052203b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.254659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57145962-d04e-4d5a-b88e-2b3aa052203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.277786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-57145962-d04e-4d5a-b88e-2b3aa052203b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:45.277786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-57145962-d04e-4d5a-b88e-2b3aa052203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:45.302005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1014/1987] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:45.308009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97992a-d9f9-4d22-984c-1190cd9ef9cb None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.318612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f97992a-d9f9-4d22-984c-1190cd9ef9cb None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.323827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.324521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.325033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.325381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.326108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:45.326497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.328212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.343388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 974/1988] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:45.347676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145962-d04e-4d5a-b88e-2b3aa052203b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.357646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57145962-d04e-4d5a-b88e-2b3aa052203b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.376256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.379431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.379431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.379431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.379431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.380972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.448068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.449735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:45.463094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a0a31d-d598-405b-bce4-f53c73530db2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.467857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.468505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.468784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.469056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] PATH_INFO: `/v3/projects/c4417f4409ba47bc9e5df70e194a8d81` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.470182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4417f4409ba47bc9e5df70e194a8d81)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.472127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.481705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1015/1989] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:45 2022] POST /identity/v3/projects => generated 375 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:45.485734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.596546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210f1a-360e-42b7-81b2-16dcf7516884 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.601815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.602428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.602813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.603197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.604254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.606475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.638257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4417f4409ba47bc9e5df70e194a8d81', 'request_id': 'req-f673025c-044f-40f9-9962-9c40646fd5e5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.648856 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4417f4409ba47bc9e5df70e194a8d81', 'request_id': 'req-f673025c-044f-40f9-9962-9c40646fd5e5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.653334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4417f4409ba47bc9e5df70e194a8d81', 'request_id': 'req-f673025c-044f-40f9-9962-9c40646fd5e5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.703025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1016/1990] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:45 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:45.706921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.722361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0de32bf-c513-4e00-b3a1-c5d325dec093 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.758538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] The token cache is being invalidate because project c4417f4409ba47bc9e5df70e194a8d81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:45.758538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.762060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:45.768775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 975/1991] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:45 2022] DELETE /identity/v3/projects/c4417f4409ba47bc9e5df70e194a8d81 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:45.772631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.783258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:45.830561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.832156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.835466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.835778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.836526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.846536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:45.847449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.864914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1017/1992] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:45.869262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.871651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:45.889561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fb81e1-db64-471c-9088-af474b654709 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.896584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f673025c-044f-40f9-9962-9c40646fd5e5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.896947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.897675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.897963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.898239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.898990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.901736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.903598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.904452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.904889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.905387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] PATH_INFO: `/v3/users/478de02b1fe8404cac372e0409a95ce9` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.907233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=478de02b1fe8404cac372e0409a95ce9)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.909639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:45.920921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1018/1993] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:45 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:45.922667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:45.937549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8880151e-36b5-47c9-8992-6a2d30776606 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:45.943792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcb3863-b401-4669-bca5-883366cd11ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:45.944496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3863-b401-4669-bca5-883366cd11ac admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:45.944774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3863-b401-4669-bca5-883366cd11ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:45.945047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcb3863-b401-4669-bca5-883366cd11ac admin admin] PATH_INFO: `/v3/projects/56ef9ea45ffe42db8b7a3a0bd3ed287c/users/f15446fb35384395b32d601b313befda/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:45.985199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb3863-b401-4669-bca5-883366cd11ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=56ef9ea45ffe42db8b7a3a0bd3ed287c, user_id=f15446fb35384395b32d601b313befda, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:45.988348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcb3863-b401-4669-bca5-883366cd11ac admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:46.068774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1019/1994] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:45 2022] PUT /identity/v3/projects/56ef9ea45ffe42db8b7a3a0bd3ed287c/users/f15446fb35384395b32d601b313befda/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:46.079448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:46.079852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:46.080178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:46.108527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '478de02b1fe8404cac372e0409a95ce9'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:46.109383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '478de02b1fe8404cac372e0409a95ce9'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:46.118684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] MFA Rules not processed for user `f15446fb35384395b32d601b313befda`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:46.119999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:46.180735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '478de02b1fe8404cac372e0409a95ce9'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:46.194091 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '478de02b1fe8404cac372e0409a95ce9'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:46.198646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1020/1995] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:46.205011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '478de02b1fe8404cac372e0409a95ce9'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:46.208183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:46.212709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:46.212821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 976/1996] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:45 2022] DELETE /identity/v3/users/478de02b1fe8404cac372e0409a95ce9 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:46.306079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dfa24c-685c-42d5-8af6-f9a1e2780924 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:46.356706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc75fa0-98f6-4ced-813c-b5d2eea4629b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:46.357482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75fa0-98f6-4ced-813c-b5d2eea4629b service glance] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:46.357769 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75fa0-98f6-4ced-813c-b5d2eea4629b service glance] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:46.358045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc75fa0-98f6-4ced-813c-b5d2eea4629b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:46.359850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dfc75fa0-98f6-4ced-813c-b5d2eea4629b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:46.489291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc75fa0-98f6-4ced-813c-b5d2eea4629b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:46.490942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc75fa0-98f6-4ced-813c-b5d2eea4629b service glance] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:46.505327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1021/1997] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:46 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:46.755602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:46.757131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:46.877443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e1f05-258b-43c1-b2a7-1dc8002762ee admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:46.885478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:46.886214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:46.887867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:46.887867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] PATH_INFO: `/v3/projects/4c2af7cd7b834493b5be760e7ec1747f` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:46.888044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2af7cd7b834493b5be760e7ec1747f)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:46.890126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.055547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2af7cd7b834493b5be760e7ec1747f', 'request_id': 'req-fa48cc84-9c8a-48ce-b569-b2241476b8ca'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.065560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2af7cd7b834493b5be760e7ec1747f', 'request_id': 'req-fa48cc84-9c8a-48ce-b569-b2241476b8ca'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.072431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2af7cd7b834493b5be760e7ec1747f', 'request_id': 'req-fa48cc84-9c8a-48ce-b569-b2241476b8ca'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.192408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] The token cache is being invalidate because project 4c2af7cd7b834493b5be760e7ec1747f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:47.193342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.193989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fa48cc84-9c8a-48ce-b569-b2241476b8ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.195565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 977/1998] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:46 2022] DELETE /identity/v3/projects/4c2af7cd7b834493b5be760e7ec1747f => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:47.201246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77750b-2d82-41f2-bea3-141cac8cdd33 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.202013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77750b-2d82-41f2-bea3-141cac8cdd33 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.202211 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77750b-2d82-41f2-bea3-141cac8cdd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.233525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4d77750b-2d82-41f2-bea3-141cac8cdd33 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:47.235990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4d77750b-2d82-41f2-bea3-141cac8cdd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:47.335812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b235-85c8-42f8-8a63-c059235d45b7 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.336074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b235-85c8-42f8-8a63-c059235d45b7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.336562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8961b235-85c8-42f8-8a63-c059235d45b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.339371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1022/1999] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:47.365940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8961b235-85c8-42f8-8a63-c059235d45b7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:47.367230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8961b235-85c8-42f8-8a63-c059235d45b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:47.375807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 978/2000] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:47.381260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77750b-2d82-41f2-bea3-141cac8cdd33 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:47.392153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77750b-2d82-41f2-bea3-141cac8cdd33 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:47.397636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:47.398268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.398746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.399060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.400037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:47.400469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:47.402314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.417527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1023/2001] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:58:47.422050 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b235-85c8-42f8-8a63-c059235d45b7 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:47.433487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8961b235-85c8-42f8-8a63-c059235d45b7 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:47.439385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:47.440006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.440312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.440598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.441533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:47.443897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.554386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:47.556429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:47.558116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 979/2002] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:47 2022] POST /identity/v3/projects => generated 363 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:47.569036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:47.573186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fd963-6435-4a9e-8591-1602301d84b5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:47.688655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:47.689323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.689697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.690128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] PATH_INFO: `/v3/users/defde50e9dd54a87984fd06508e7fa7b` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.691442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] RBAC: Authorizing `identity:delete_user(user_id=defde50e9dd54a87984fd06508e7fa7b)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:47.693476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.704107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740093c-dbae-4d6a-a499-002227f55a08 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:47.710440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:47.711741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.711741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.712055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.712805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:47.716001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.795867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=2,keystone:SELECT=92,keystone:INSERT=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:47.799173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 980/2003] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:47 2022] POST /identity/v3/users => generated 282 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:47.803928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:47.813835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3e1910-b47f-4048-93d0-9653d2eeaa76 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:47.818611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:47.819228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.819507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.819781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.820426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:47.822025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.834005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 981/2004] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:47.838285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:47.849841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2db028-678b-4083-8af9-67f3d2e9544a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:47.853310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:47.853912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.854194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.854470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.855222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:47.856811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.867941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 982/2005] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:47.871773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:47.880364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'defde50e9dd54a87984fd06508e7fa7b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.881173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'defde50e9dd54a87984fd06508e7fa7b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.887887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf1faca-d1d2-48b8-ad7b-f304c00abb3e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:47.893819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7258598-7a6a-44a7-b1ce-e0e3f19205a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:47.894538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258598-7a6a-44a7-b1ce-e0e3f19205a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.894780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258598-7a6a-44a7-b1ce-e0e3f19205a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.895087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7258598-7a6a-44a7-b1ce-e0e3f19205a2 admin admin] PATH_INFO: `/v3/projects/9c467ecc132a47c487e13dfc2eb5f549/users/a00d9c99ed5243f88d9f04b984ae0345/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:47.915871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7258598-7a6a-44a7-b1ce-e0e3f19205a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c467ecc132a47c487e13dfc2eb5f549, user_id=a00d9c99ed5243f88d9f04b984ae0345, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:47.920124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7258598-7a6a-44a7-b1ce-e0e3f19205a2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:47.959270 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'defde50e9dd54a87984fd06508e7fa7b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.967615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'defde50e9dd54a87984fd06508e7fa7b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.983811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53f899be-9d6f-443c-8a03-fa3c0de5400c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'defde50e9dd54a87984fd06508e7fa7b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:47.991050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1024/2006] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:47 2022] DELETE /identity/v3/users/defde50e9dd54a87984fd06508e7fa7b => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:47.995975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:47.996384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:47.996768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:48.018052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:48.019204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:48.046860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 983/2007] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:47 2022] PUT /identity/v3/projects/9c467ecc132a47c487e13dfc2eb5f549/users/a00d9c99ed5243f88d9f04b984ae0345/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:48.051953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:48.052483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:48.053097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:48.112225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] MFA Rules not processed for user `a00d9c99ed5243f88d9f04b984ae0345`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:48.113586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:48.158242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1025/2008] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:58:48.171266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:48.172913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:48.216969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 984/2009] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:48.221200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:48.223837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:48.246817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0106558-cb25-4530-83f9-847ce697d385 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:48.331498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:48.335179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:48.335496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:48.338622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:48.362424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b34bb-2845-4ccc-9f27-a4ab82eb570d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:48.379576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:48.380875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:48.381292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:48.381995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:48.384392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:48.386485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:48.395236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:48.433796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:48.435339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:48.445899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1026/2010] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:58:48.528894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 985/2011] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:48 2022] POST /identity/v3/projects => generated 361 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:48.532770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:48.556094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a1b20-a2e6-44e2-a39b-bb814c7505e5 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:48.653553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:48.654637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:48.655150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:48.655618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:48.656531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:48.659369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:48.775178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1027/2012] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:48 2022] POST /identity/v3/users => generated 287 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:48.779163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:48.798374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c785f8-75c7-45d8-afd9-688908af6da9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:48.806084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:48.807342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:48.807741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:48.808141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:48.808929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:48.815471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:48.840729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 986/2013] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:48 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:48.845416 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:48.858225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8147962-9610-489d-af14-3981ce74a6ee admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:48.864585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:48.865586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:48.866227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:48.866815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] PATH_INFO: `/v3/projects/7eb578d5724c4c8ab45724e8ef841b29/users/c21da29e9c4b47868a0e8fb0c0defb85/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:48.898850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb578d5724c4c8ab45724e8ef841b29, user_id=c21da29e9c4b47868a0e8fb0c0defb85, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:48.905039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:49.007927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1028/2014] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:48 2022] PUT /identity/v3/projects/7eb578d5724c4c8ab45724e8ef841b29/users/c21da29e9c4b47868a0e8fb0c0defb85/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:49.012233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:49.023512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673dd0e6-d38b-40a8-abbe-6f36f20aba47 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:49.057712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:49.059528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:49.130021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:49.130709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:49.131017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:49.131331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:49.132018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:49.134814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:49.152364 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 987/2015] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:49 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:49.162554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:49.189887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6f3566-1809-4a41-b1ea-5c2f6619c6a2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:49.196976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1f7b2c-8d06-4a7a-b7f4-0d4a65eec126 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:49.197589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5dc4a6-f41e-40e5-a867-1829ba5a8935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:49.198284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dc4a6-f41e-40e5-a867-1829ba5a8935 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:49.198572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dc4a6-f41e-40e5-a867-1829ba5a8935 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:49.198931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5dc4a6-f41e-40e5-a867-1829ba5a8935 admin admin] PATH_INFO: `/v3/projects/7eb578d5724c4c8ab45724e8ef841b29/users/c21da29e9c4b47868a0e8fb0c0defb85/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:49.203905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dc4a6-f41e-40e5-a867-1829ba5a8935 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb578d5724c4c8ab45724e8ef841b29, user_id=c21da29e9c4b47868a0e8fb0c0defb85, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:49.205485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5dc4a6-f41e-40e5-a867-1829ba5a8935 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:49.213420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:49.214152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:49.214451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:49.214892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] PATH_INFO: `/v3/projects/be745b8ac2b046bcadd752ea89049bd1` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:49.216325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be745b8ac2b046bcadd752ea89049bd1)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:49.218967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:49.221154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 988/2016] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:49 2022] PUT /identity/v3/projects/7eb578d5724c4c8ab45724e8ef841b29/users/c21da29e9c4b47868a0e8fb0c0defb85/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:49.232800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:49.233092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:49.234039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:49.276966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] MFA Rules not processed for user `c21da29e9c4b47868a0e8fb0c0defb85`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:49.278261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:49.363494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be745b8ac2b046bcadd752ea89049bd1', 'request_id': 'req-ba12356c-51dc-41b5-a19b-0d65a41a9833'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.369588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 989/2017] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:49 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:49.375305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be745b8ac2b046bcadd752ea89049bd1', 'request_id': 'req-ba12356c-51dc-41b5-a19b-0d65a41a9833'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.383971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:49.385454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:49.465083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9226d3f-c74e-44e2-b3a2-79bb7235c479 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:49.491258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be745b8ac2b046bcadd752ea89049bd1', 'request_id': 'req-ba12356c-51dc-41b5-a19b-0d65a41a9833'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.514988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] The token cache is being invalidate because project be745b8ac2b046bcadd752ea89049bd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:49.515577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.516221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:49.516909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.523659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1029/2018] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:49 2022] DELETE /identity/v3/projects/be745b8ac2b046bcadd752ea89049bd1 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:49.527505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:49.531953 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:49.548752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:49.549685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:49.550331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:49.550894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:49.553927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:49.604848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:49.637069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba12356c-51dc-41b5-a19b-0d65a41a9833 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:49.647556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:49.649748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:49.651080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:49.651795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:49.652084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:49.652364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] PATH_INFO: `/v3/users/b8b663d199b94d398ecb6001af7df827` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:49.653867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8b663d199b94d398ecb6001af7df827)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:49.655947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:49.665442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 990/2019] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:49 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:58:49.896803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8b663d199b94d398ecb6001af7df827'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.897726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8b663d199b94d398ecb6001af7df827'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.970513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8b663d199b94d398ecb6001af7df827'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.983791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8b663d199b94d398ecb6001af7df827'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:49.993052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:49.995410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:50.003947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8b663d199b94d398ecb6001af7df827'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:50.007825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad30c7e1-c7b4-4853-ac0f-349ae3321c3b service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:50.013921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1030/2020] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:49 2022] DELETE /identity/v3/users/b8b663d199b94d398ecb6001af7df827 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:50.014077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964011c-1f51-41f1-9813-83e9a8fd93a4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:50.014077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964011c-1f51-41f1-9813-83e9a8fd93a4 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:50.014077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964011c-1f51-41f1-9813-83e9a8fd93a4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:50.014077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964011c-1f51-41f1-9813-83e9a8fd93a4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:50.014664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3964011c-1f51-41f1-9813-83e9a8fd93a4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:50.082165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964011c-1f51-41f1-9813-83e9a8fd93a4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:50.084619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964011c-1f51-41f1-9813-83e9a8fd93a4 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:50.096707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 991/2021] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:49 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:50.604674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:50.644770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:50.646802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:50.757459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0439fee5-6e24-4e96-b943-9f840e5cabe5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:50.763271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:50.764077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:50.764559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:50.765001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] PATH_INFO: `/v3/projects/66f8e1b4c2c841cebce9fc6a7079a370` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:50.766397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66f8e1b4c2c841cebce9fc6a7079a370)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:50.768666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:50.827724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:50.944044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66f8e1b4c2c841cebce9fc6a7079a370', 'request_id': 'req-0e8e4a06-1512-416b-966e-0a9027255217'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:50.951814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66f8e1b4c2c841cebce9fc6a7079a370', 'request_id': 'req-0e8e4a06-1512-416b-966e-0a9027255217'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:51.043466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66f8e1b4c2c841cebce9fc6a7079a370', 'request_id': 'req-0e8e4a06-1512-416b-966e-0a9027255217'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:51.056569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] The token cache is being invalidate because project 66f8e1b4c2c841cebce9fc6a7079a370 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:51.056911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:51.057617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0e8e4a06-1512-416b-966e-0a9027255217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:51.059454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1031/2022] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:50 2022] DELETE /identity/v3/projects/66f8e1b4c2c841cebce9fc6a7079a370 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:51.064380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae24a-9388-4954-b3f4-04c8fb3213a0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.064872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae24a-9388-4954-b3f4-04c8fb3213a0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.064989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30eae24a-9388-4954-b3f4-04c8fb3213a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.087746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-30eae24a-9388-4954-b3f4-04c8fb3213a0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:51.090415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-30eae24a-9388-4954-b3f4-04c8fb3213a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:51.157622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 992/2023] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:51.165457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52893ab-6b07-4cf1-a438-4e6945d18297 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.165746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52893ab-6b07-4cf1-a438-4e6945d18297 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.166032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52893ab-6b07-4cf1-a438-4e6945d18297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.194290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d52893ab-6b07-4cf1-a438-4e6945d18297 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:51.194290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d52893ab-6b07-4cf1-a438-4e6945d18297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:51.197242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1032/2024] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:51.201511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eae24a-9388-4954-b3f4-04c8fb3213a0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:51.211287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30eae24a-9388-4954-b3f4-04c8fb3213a0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:51.217173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:51.217173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.217173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.217173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.217860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:51.218167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:51.219824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:51.244331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 993/2025] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:51.246550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52893ab-6b07-4cf1-a438-4e6945d18297 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:51.260130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52893ab-6b07-4cf1-a438-4e6945d18297 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:51.265202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:51.265817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.266097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.266367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.267075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:51.269121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:51.300693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:51.338292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1033/2026] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:51 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:51.342600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:51.354357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77890f7-85fe-4e90-8f9f-ef8925b7eb37 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:51.414941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:51.415729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.416018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.416287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.416937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:51.419331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:51.512636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 994/2027] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:51 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:51.516848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:51.527455 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fef33e-340f-4a63-870b-46edc8e9d967 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:51.532200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:51.532807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.533116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.533392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.534042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:51.535677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:51.546305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1034/2028] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:51.550657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:51.561877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174e2e64-a283-4992-9ac5-610a519cb8f5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:51.566734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64aab1-30dd-43ad-a673-b07376dca607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:51.567615 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64aab1-30dd-43ad-a673-b07376dca607 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.568087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64aab1-30dd-43ad-a673-b07376dca607 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.568372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64aab1-30dd-43ad-a673-b07376dca607 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.569035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64aab1-30dd-43ad-a673-b07376dca607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:51.570632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64aab1-30dd-43ad-a673-b07376dca607 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:51.582141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 995/2029] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:51.589345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:51.600155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b5e03b-aecd-486c-b698-3b5f5f1f946f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:51.604911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:51.605563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.606916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.606916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] PATH_INFO: `/v3/projects/bd60082e4876483ebfe3b4979c8422e6/users/99114b9a054f4c819b1ae5ab09dbe860/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.620567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd60082e4876483ebfe3b4979c8422e6, user_id=99114b9a054f4c819b1ae5ab09dbe860, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:51.623276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:51.718309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:51.721616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1035/2030] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:51 2022] PUT /identity/v3/projects/bd60082e4876483ebfe3b4979c8422e6/users/99114b9a054f4c819b1ae5ab09dbe860/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:51.728349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53993432-bd15-427b-8607-3693f378867c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.728635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53993432-bd15-427b-8607-3693f378867c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.728921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53993432-bd15-427b-8607-3693f378867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.756984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-53993432-bd15-427b-8607-3693f378867c None None] MFA Rules not processed for user `99114b9a054f4c819b1ae5ab09dbe860`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:51.760715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-53993432-bd15-427b-8607-3693f378867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:51.833486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 996/2031] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:51.837666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:51.912268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c617a3e-6fa2-4740-8cad-0c287dd9f098 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:51.919118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:51.919762 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:51.920014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:51.920285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:51.920946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:51.923072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:52.080177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1036/2032] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:51 2022] POST /identity/v3/projects => generated 375 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:52.084417 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53993432-bd15-427b-8607-3693f378867c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:52.095103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53993432-bd15-427b-8607-3693f378867c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:52.104482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:52.167603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:52.168443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:52.172301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:52.172301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:52.172301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:52.172301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:52.386275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 997/2033] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:52 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:52.390208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:52.408200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee692417-5520-421d-a4d5-85359d236b03 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:52.422345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:52.423123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:52.423642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:52.425025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:52.427057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:52.429934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:52.454149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1037/2034] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:52.456943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:52.477756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88128066-2d19-4fbe-ba4e-210be9196f3c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:52.481230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:52.495675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87345835-31a7-42d1-8762-959d424c2565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:52.496356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345835-31a7-42d1-8762-959d424c2565 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:52.496657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345835-31a7-42d1-8762-959d424c2565 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:52.496943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345835-31a7-42d1-8762-959d424c2565 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:52.497616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87345835-31a7-42d1-8762-959d424c2565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:52.499301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87345835-31a7-42d1-8762-959d424c2565 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:52.533597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 998/2035] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:52.535697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:52.548467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5133f-7ba0-46d1-a835-40075d5a747a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:52.555434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:52.556323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:52.556737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:52.557022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] PATH_INFO: `/v3/projects/60f6e6c0841a4e02a0d838c8e27567f1/users/f5a96d81e78c48dc9eda994985772435/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:52.579806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f6e6c0841a4e02a0d838c8e27567f1, user_id=f5a96d81e78c48dc9eda994985772435, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:52.584157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:52.668639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1038/2036] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:52 2022] PUT /identity/v3/projects/60f6e6c0841a4e02a0d838c8e27567f1/users/f5a96d81e78c48dc9eda994985772435/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:52.682135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2851-70cd-4c45-9428-a68063c8fd7a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:52.682626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2851-70cd-4c45-9428-a68063c8fd7a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:52.683233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc2851-70cd-4c45-9428-a68063c8fd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:52.722398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-39dc2851-70cd-4c45-9428-a68063c8fd7a None None] MFA Rules not processed for user `f5a96d81e78c48dc9eda994985772435`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:52.724294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-39dc2851-70cd-4c45-9428-a68063c8fd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:52.826943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 999/2037] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:52.828913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:52.919676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0940fe8-d318-4f8f-b292-87ca9cfabe0f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:52.927971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:52.928623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:52.928909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:52.929191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:52.929853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:52.932642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:53.063372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1039/2038] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:52 2022] POST /identity/v3/projects => generated 377 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:58:53.067389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2851-70cd-4c45-9428-a68063c8fd7a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:53.078309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc2851-70cd-4c45-9428-a68063c8fd7a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:53.136625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:53.137322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:53.137531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:53.137811 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:53.138540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:53.140560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:53.241679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1000/2039] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:53 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:53.245224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:53.257262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f84b8f-2027-41ab-98d5-90c4212e10dc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:53.264882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:53.264882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:53.264882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:53.264882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:53.265214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:53.265598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:53.278697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1040/2040] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:53.283159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:53.284694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:53.295908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a8eb6f-870a-4f85-ab01-18e8eec31e03 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:53.302161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:53.302972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:53.303258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:53.303529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] PATH_INFO: `/v3/projects/073219a511e64679a7c545942b181e8a/users/06ef105beb4449c5a451463987a68daa/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:53.326694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] RBAC: Authorizing `identity:create_grant(project_id=073219a511e64679a7c545942b181e8a, user_id=06ef105beb4449c5a451463987a68daa, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:53.331592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:53.417720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1001/2041] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:53 2022] PUT /identity/v3/projects/073219a511e64679a7c545942b181e8a/users/06ef105beb4449c5a451463987a68daa/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:53.422244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:53.432482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c5c8d-9c5d-43d6-8820-5e5ee4941598 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:53.540436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac709a9-4608-4b60-9ac9-26c6d2af4a64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:53.541072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac709a9-4608-4b60-9ac9-26c6d2af4a64 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:53.541371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac709a9-4608-4b60-9ac9-26c6d2af4a64 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:53.542613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac709a9-4608-4b60-9ac9-26c6d2af4a64 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:53.543305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac709a9-4608-4b60-9ac9-26c6d2af4a64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:53.549116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac709a9-4608-4b60-9ac9-26c6d2af4a64 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:53.577763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1041/2042] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:53 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:53.587635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:53.632031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e4aa9f-26cd-4a25-8c27-3bc43967bb8f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:53.649015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:53.653087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:53.653087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:53.653087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] PATH_INFO: `/v3/projects/073219a511e64679a7c545942b181e8a/users/06ef105beb4449c5a451463987a68daa/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:53.671964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=073219a511e64679a7c545942b181e8a, user_id=06ef105beb4449c5a451463987a68daa, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:53.674939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:53.689625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1002/2043] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:53 2022] PUT /identity/v3/projects/073219a511e64679a7c545942b181e8a/users/06ef105beb4449c5a451463987a68daa/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:53.702498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:53.703061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:53.703061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:53.741581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] MFA Rules not processed for user `06ef105beb4449c5a451463987a68daa`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:53.742981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:53.861579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1042/2044] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:53 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:53.985361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:53.987190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:54.050179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b30a4b-87cf-46e5-b0aa-6b1f4b0274c4 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:54.053994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e241a-b571-4f16-aec1-d10dc53a44ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:54.054613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e241a-b571-4f16-aec1-d10dc53a44ba service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:54.054928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e241a-b571-4f16-aec1-d10dc53a44ba service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:54.055209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e241a-b571-4f16-aec1-d10dc53a44ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:54.087801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:54.125607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e241a-b571-4f16-aec1-d10dc53a44ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:54.127532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5e241a-b571-4f16-aec1-d10dc53a44ba service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:54.151681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1003/2045] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:53 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:54.594544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:54.596253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:54.665414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ed2610-bf87-4aef-b75b-899452c57eb9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:54.670123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:54.670841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:54.671129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:54.671513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] PATH_INFO: `/v3/users/a00d9c99ed5243f88d9f04b984ae0345` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:54.672622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=a00d9c99ed5243f88d9f04b984ae0345)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:54.674661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:54.877426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a00d9c99ed5243f88d9f04b984ae0345'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:54.878162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a00d9c99ed5243f88d9f04b984ae0345'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:54.947093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a00d9c99ed5243f88d9f04b984ae0345'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:54.959070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a00d9c99ed5243f88d9f04b984ae0345'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:54.972563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a00d9c99ed5243f88d9f04b984ae0345'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:54.979360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1043/2046] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:54 2022] DELETE /identity/v3/users/a00d9c99ed5243f88d9f04b984ae0345 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:54.983993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:54.984376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:54.984739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:55.006380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:55.007647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:55.076736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1004/2047] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:55.087196 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:55.088624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:55.119432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:55.150885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabc73a-7ff4-454a-a56e-f7787e804dcb admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:55.154508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:55.155131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:55.155412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:55.155682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:55.165734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:55.167232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:55.177674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1044/2048] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:55.554931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:55.847928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:55.849743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:55.862947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e020c66-a88f-4009-a5f8-faa74c7eaf7d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:55.869489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:55.870364 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:55.870756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:55.871225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] PATH_INFO: `/v3/projects/9c467ecc132a47c487e13dfc2eb5f549` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:55.872833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c467ecc132a47c487e13dfc2eb5f549)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:55.874881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:55.991027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c467ecc132a47c487e13dfc2eb5f549', 'request_id': 'req-e60606e1-c5f5-448d-a044-d0dd77272877'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:55.999962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c467ecc132a47c487e13dfc2eb5f549', 'request_id': 'req-e60606e1-c5f5-448d-a044-d0dd77272877'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.007588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c467ecc132a47c487e13dfc2eb5f549', 'request_id': 'req-e60606e1-c5f5-448d-a044-d0dd77272877'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.127755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] The token cache is being invalidate because project 9c467ecc132a47c487e13dfc2eb5f549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:56.128190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.130028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.140050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:56.155366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1005/2049] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:55 2022] DELETE /identity/v3/projects/9c467ecc132a47c487e13dfc2eb5f549 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:56.166248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a02fb8-503c-4b2e-942a-49d4d71a42de service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:56.266081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:56.266669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:56.266995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:56.267281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] PATH_INFO: `/v3/users/c21da29e9c4b47868a0e8fb0c0defb85` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:56.268735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c21da29e9c4b47868a0e8fb0c0defb85)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:56.271531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:56.401217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:56.402980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:56.486792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60606e1-c5f5-448d-a044-d0dd77272877 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:56.490968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:56.492560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:56.492850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:56.493133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:56.495505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:56.573064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c21da29e9c4b47868a0e8fb0c0defb85'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.574968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c21da29e9c4b47868a0e8fb0c0defb85'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.577457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:56.578953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:56.589732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1006/2050] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:58:56.718578 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c21da29e9c4b47868a0e8fb0c0defb85'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.737025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c21da29e9c4b47868a0e8fb0c0defb85'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.751287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79e08bec-e5b1-4740-9db9-51b8a412d19d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c21da29e9c4b47868a0e8fb0c0defb85'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:56.758504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1045/2051] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:58:56 2022] DELETE /identity/v3/users/c21da29e9c4b47868a0e8fb0c0defb85 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:56.901664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:57.350477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:57.352223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:57.368336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5b6fe5-024c-4591-b934-719f8b40b386 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:57.492657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:57.493712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:57.494446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:57.494900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] PATH_INFO: `/v3/projects/7eb578d5724c4c8ab45724e8ef841b29` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:57.497307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb578d5724c4c8ab45724e8ef841b29)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:57.500154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:57.553068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:58:57.637658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb578d5724c4c8ab45724e8ef841b29', 'request_id': 'req-f85d182a-4f7f-448d-90d2-ff1601be5a8a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:57.646086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb578d5724c4c8ab45724e8ef841b29', 'request_id': 'req-f85d182a-4f7f-448d-90d2-ff1601be5a8a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:57.664558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb578d5724c4c8ab45724e8ef841b29', 'request_id': 'req-f85d182a-4f7f-448d-90d2-ff1601be5a8a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:57.766887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] The token cache is being invalidate because project 7eb578d5724c4c8ab45724e8ef841b29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:58:57.767515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:57.769216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f85d182a-4f7f-448d-90d2-ff1601be5a8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:58:57.772484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1007/2052] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:58:57 2022] DELETE /identity/v3/projects/7eb578d5724c4c8ab45724e8ef841b29 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:58:57.778510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2192a9-31b6-4f5c-a7f3-2cd37cce1819 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:57.779071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2192a9-31b6-4f5c-a7f3-2cd37cce1819 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:57.779255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2192a9-31b6-4f5c-a7f3-2cd37cce1819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:57.801670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2a2192a9-31b6-4f5c-a7f3-2cd37cce1819 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:57.803245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2a2192a9-31b6-4f5c-a7f3-2cd37cce1819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:57.907057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1046/2053] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:57.915365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c395-d258-4489-9d9f-41d956d42323 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:57.915688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c395-d258-4489-9d9f-41d956d42323 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:57.915924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438c395-d258-4489-9d9f-41d956d42323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:57.940384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-6438c395-d258-4489-9d9f-41d956d42323 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:57.942426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6438c395-d258-4489-9d9f-41d956d42323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:57.962905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1008/2054] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:57.963052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2192a9-31b6-4f5c-a7f3-2cd37cce1819 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:57.973142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2192a9-31b6-4f5c-a7f3-2cd37cce1819 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:57.978392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:57.979028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:57.979419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:57.979865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:57.980528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:58:57.980836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:57.982477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:57.995983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1047/2055] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:58:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:58:58.000690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c395-d258-4489-9d9f-41d956d42323 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:58.010653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438c395-d258-4489-9d9f-41d956d42323 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:58.016757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:58.017470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.017762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.018038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.018685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:58.020891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:58.205574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1009/2056] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:57 2022] POST /identity/v3/projects => generated 369 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:58.210308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:58.220503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8fd66-bf8c-4494-b724-fbea7e996bc9 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:58.278273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:58.278922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.279208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.279484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.280147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:58.282163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:58.388115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1048/2057] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:58 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:58.392415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:58.403134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4782574c-7f08-4fb2-b17f-831475b8801a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:58.407827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:58.408431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.408716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.408991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.410153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:58.411268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:58.422240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1010/2058] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:58:58.427216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:58.438264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d518cb0-2e1b-41c2-9db7-3cfc1d92e0e0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:58.447463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a97cd-3be8-46b2-a983-31b85f59aa33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:58.448162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a97cd-3be8-46b2-a983-31b85f59aa33 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.448448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a97cd-3be8-46b2-a983-31b85f59aa33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.448729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a97cd-3be8-46b2-a983-31b85f59aa33 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.449387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a97cd-3be8-46b2-a983-31b85f59aa33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:58.451077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a97cd-3be8-46b2-a983-31b85f59aa33 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:58.463910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1049/2059] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:58.468121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:58.478780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f422-89d2-4833-aec1-8b54fc4639f4 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:58.483409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:58.484060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.484338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.484617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] PATH_INFO: `/v3/projects/08f96add7b69467eaf920fd5756ebdaf/users/9b927cf9bc3e4f09a08f2aa208745973/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.499355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08f96add7b69467eaf920fd5756ebdaf, user_id=9b927cf9bc3e4f09a08f2aa208745973, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:58.501995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:58.575589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1011/2060] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:58 2022] PUT /identity/v3/projects/08f96add7b69467eaf920fd5756ebdaf/users/9b927cf9bc3e4f09a08f2aa208745973/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:58:58.586117 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.586638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.587046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.622741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] MFA Rules not processed for user `9b927cf9bc3e4f09a08f2aa208745973`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:58:58.624147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:58.704166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1050/2061] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:58:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:58:58.710208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:58.813459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58386662-34d2-4dbc-8f5f-7192fb41a4f3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:58.827991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:58.827991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.827991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.827991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.828948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:58.828948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:58.893130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:58.895073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:58.958747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c068a6-a100-459b-93f1-21cc418c0d78 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:58.963058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:58.963709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:58.964014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:58.964287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:58.966133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:58:59.047698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:59.049603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:59.062633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1051/2062] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:58:58 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:58:59.220321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1012/2063] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:58:58 2022] POST /identity/v3/projects => generated 369 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:59.221459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:59.225146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b801c03a-224e-4c67-a1da-9339a5baddd7 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:59.297240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:59.298339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:59.300920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:59.301553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:59.303159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:59.307045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:59.893518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1052/2064] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:58:59 2022] POST /identity/v3/users => generated 291 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:58:59.899941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:58:59.925257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2caca-afe2-4797-a281-1d9ba3845562 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:58:59.944725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:58:59.945590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:58:59.946031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:58:59.946471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:58:59.947515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:58:59.949318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:58:59.985413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1013/2065] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:58:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:58:59.990032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:00.011764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdacd63-47cf-4871-b21a-815f9a7bfdfd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:00.028150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:00.029088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:00.029848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:00.029848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] PATH_INFO: `/v3/projects/09542283e6eb4fb5a4acc58a0467a807/users/c5e42d9e8f4a492dbc3ab52786eb0b2e/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:00.080679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=09542283e6eb4fb5a4acc58a0467a807, user_id=c5e42d9e8f4a492dbc3ab52786eb0b2e, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:00.080679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:00.171549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1053/2066] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:58:59 2022] PUT /identity/v3/projects/09542283e6eb4fb5a4acc58a0467a807/users/c5e42d9e8f4a492dbc3ab52786eb0b2e/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:00.174985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:00.189359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2683e57d-212f-4ed9-ad68-f8c1bd90fa0f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:00.285786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579654a8-0ce8-4d66-a766-92224e1d0f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:00.286786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579654a8-0ce8-4d66-a766-92224e1d0f92 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:00.287279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579654a8-0ce8-4d66-a766-92224e1d0f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:00.287789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579654a8-0ce8-4d66-a766-92224e1d0f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:00.288915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579654a8-0ce8-4d66-a766-92224e1d0f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:00.290899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579654a8-0ce8-4d66-a766-92224e1d0f92 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:00.303209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1014/2067] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:00 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:00.307872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:00.321569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1c12-9238-4922-835f-72b5558e61cc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:00.327907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:00.328945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:00.329241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:00.329524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] PATH_INFO: `/v3/projects/09542283e6eb4fb5a4acc58a0467a807/users/c5e42d9e8f4a492dbc3ab52786eb0b2e/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:00.331665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09542283e6eb4fb5a4acc58a0467a807, user_id=c5e42d9e8f4a492dbc3ab52786eb0b2e, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:00.334869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:00.349130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1054/2068] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:00 2022] PUT /identity/v3/projects/09542283e6eb4fb5a4acc58a0467a807/users/c5e42d9e8f4a492dbc3ab52786eb0b2e/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:00.360620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caffcf-a3e9-4fef-8cc6-b7e5134b59ab None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:00.361172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caffcf-a3e9-4fef-8cc6-b7e5134b59ab None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:00.361600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23caffcf-a3e9-4fef-8cc6-b7e5134b59ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:00.397947 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-23caffcf-a3e9-4fef-8cc6-b7e5134b59ab None None] MFA Rules not processed for user `c5e42d9e8f4a492dbc3ab52786eb0b2e`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:00.400571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-23caffcf-a3e9-4fef-8cc6-b7e5134b59ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:00.564159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1015/2069] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:00.581424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:00.657912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7758-2e2e-4ad8-891b-c4fc83dfef29 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:00.662321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91a2a54-6451-48cd-9121-fbbb9836bb5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:00.662969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2a54-6451-48cd-9121-fbbb9836bb5e service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:00.663256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2a54-6451-48cd-9121-fbbb9836bb5e service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:00.663533 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91a2a54-6451-48cd-9121-fbbb9836bb5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:00.673315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2a54-6451-48cd-9121-fbbb9836bb5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:00.674849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91a2a54-6451-48cd-9121-fbbb9836bb5e service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:00.684106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1055/2070] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:00.739405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:02.346272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:04.264850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc184313-07dd-4268-bee5-7d74c7a63c32 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:04.265886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc184313-07dd-4268-bee5-7d74c7a63c32 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:04.266177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc184313-07dd-4268-bee5-7d74c7a63c32 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:04.268023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1016/2071] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 06:59:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 06:59:04.285540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:04.286349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:04.286810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:04.310413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:04.312051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:04.399429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1056/2072] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 06:59:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:04.425301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc184313-07dd-4268-bee5-7d74c7a63c32 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:04.427315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bc184313-07dd-4268-bee5-7d74c7a63c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:04.430423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:04.443595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:04.462166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc184313-07dd-4268-bee5-7d74c7a63c32 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:04.468467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:04.469196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:04.469487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:04.469801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:04.487121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:04.487121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:04.499203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1017/2073] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:04.542636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494d140d-9b13-4314-9c87-7a7792f2b65d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:04.550249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:04.551408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:04.551911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:04.552190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] PATH_INFO: `/v3/users/9e77780ae7d749f19d6840f69626b236` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:04.553525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e77780ae7d749f19d6840f69626b236)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:04.555706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:04.877598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e77780ae7d749f19d6840f69626b236'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:04.878592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e77780ae7d749f19d6840f69626b236'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:04.983946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e77780ae7d749f19d6840f69626b236'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.003421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e77780ae7d749f19d6840f69626b236'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.036304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e77780ae7d749f19d6840f69626b236'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.046815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1057/2074] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:04 2022] DELETE /identity/v3/users/9e77780ae7d749f19d6840f69626b236 => generated 0 bytes in 620 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:05.118147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:05.367888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:05.378222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42ec2c1-b056-4bf0-b0a9-26cd2e4c382a service placement] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:05.428603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:05.431082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:05.446887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:05.454010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:05.454010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:05.454010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] PATH_INFO: `/v3/projects/63e9ae8ffd464426871f97ba03dab036` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:05.454010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=63e9ae8ffd464426871f97ba03dab036)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:05.454010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:05.536711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04bc0e7-86f2-475e-831e-efc49bf5f86b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:05.542137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:05.542896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:05.543265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:05.543926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] PATH_INFO: `/v3/users/9b927cf9bc3e4f09a08f2aa208745973` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:05.545298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b927cf9bc3e4f09a08f2aa208745973)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:05.547461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:05.589810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63e9ae8ffd464426871f97ba03dab036', 'request_id': 'req-157ebc4b-89f9-4f2e-8665-13ed524627ce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.596572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63e9ae8ffd464426871f97ba03dab036', 'request_id': 'req-157ebc4b-89f9-4f2e-8665-13ed524627ce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.603545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63e9ae8ffd464426871f97ba03dab036', 'request_id': 'req-157ebc4b-89f9-4f2e-8665-13ed524627ce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.679911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] The token cache is being invalidate because project 63e9ae8ffd464426871f97ba03dab036 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:05.680189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.681028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.685805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1018/2075] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:05 2022] DELETE /identity/v3/projects/63e9ae8ffd464426871f97ba03dab036 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:05.685805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:05.685805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:05.765760 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b927cf9bc3e4f09a08f2aa208745973'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.766453 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b927cf9bc3e4f09a08f2aa208745973'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.769067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ebc4b-89f9-4f2e-8665-13ed524627ce admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:05.774181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:05.775143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:05.775428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:05.775709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] PATH_INFO: `/v3/users/99114b9a054f4c819b1ae5ab09dbe860` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:05.776865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] RBAC: Authorizing `identity:delete_user(user_id=99114b9a054f4c819b1ae5ab09dbe860)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:05.778964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:05.833003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b927cf9bc3e4f09a08f2aa208745973'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.835791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:05.844202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b927cf9bc3e4f09a08f2aa208745973'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.858157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4affca8-f9dd-42e2-9957-93f81b063b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b927cf9bc3e4f09a08f2aa208745973'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.869776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1058/2076] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:05 2022] DELETE /identity/v3/users/9b927cf9bc3e4f09a08f2aa208745973 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:05.872218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8f35-43c8-4d70-8352-b1c7140b594d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:05.872773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8f35-43c8-4d70-8352-b1c7140b594d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:05.874574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8c8f35-43c8-4d70-8352-b1c7140b594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:05.902249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-db8c8f35-43c8-4d70-8352-b1c7140b594d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:05.902902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-db8c8f35-43c8-4d70-8352-b1c7140b594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:05.969756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99114b9a054f4c819b1ae5ab09dbe860'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:05.971178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99114b9a054f4c819b1ae5ab09dbe860'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:06.044144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1059/2077] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:06.045028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ef0a6-6048-47b7-9cfc-7ef94d3650c7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.045322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ef0a6-6048-47b7-9cfc-7ef94d3650c7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.045602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494ef0a6-6048-47b7-9cfc-7ef94d3650c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.079827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-494ef0a6-6048-47b7-9cfc-7ef94d3650c7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:06.081062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-494ef0a6-6048-47b7-9cfc-7ef94d3650c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.110020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1060/2078] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:06.111502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.111789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.112064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.122805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99114b9a054f4c819b1ae5ab09dbe860'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:06.148065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:06.148810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99114b9a054f4c819b1ae5ab09dbe860'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:06.155153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.165797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1061/2079] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:06.165797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.165797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.168696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99114b9a054f4c819b1ae5ab09dbe860'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:06.185256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1019/2080] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:05 2022] DELETE /identity/v3/users/99114b9a054f4c819b1ae5ab09dbe860 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:06.186365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.188121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.241815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e494be9-39c8-4599-a471-1f4b89060979 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.289187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51e44ed-afa5-40ef-ab43-f8d8773f400e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.294327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61f8f4b-a937-47f7-8a4c-8fe76c57b6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.295192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8f4b-a937-47f7-8a4c-8fe76c57b6f0 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.295545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8f4b-a937-47f7-8a4c-8fe76c57b6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.295889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61f8f4b-a937-47f7-8a4c-8fe76c57b6f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.297282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8f4b-a937-47f7-8a4c-8fe76c57b6f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:06.297675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8f4b-a937-47f7-8a4c-8fe76c57b6f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.299501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61f8f4b-a937-47f7-8a4c-8fe76c57b6f0 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.317432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1020/2081] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:06.318961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82190-f5f2-43e6-bd51-54451e78279e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.319456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82190-f5f2-43e6-bd51-54451e78279e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.319795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb82190-f5f2-43e6-bd51-54451e78279e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.378942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.379723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0fb82190-f5f2-43e6-bd51-54451e78279e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:06.380133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.380133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.380133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.380343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0fb82190-f5f2-43e6-bd51-54451e78279e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.380429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.380525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1021/2082] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:06.380525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82190-f5f2-43e6-bd51-54451e78279e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.380670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.380670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.380814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb82190-f5f2-43e6-bd51-54451e78279e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.380889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1062/2083] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:06.380958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.380958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.380958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.380958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.381237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.383740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.386019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.387816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.400081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e7331b-54b5-433d-8dd4-2486f716ca23 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.404611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.406640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.406640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.406640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.415973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.417529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.427725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1063/2084] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:06.542980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1022/2085] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:06 2022] POST /identity/v3/projects => generated 355 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:06.547538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.558662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6165b2-609b-41c9-91e8-aa43e3c65893 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.634420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.638570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.638570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.638570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.638570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.639670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.735249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1064/2086] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:06 2022] POST /identity/v3/users => generated 278 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:06.740248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.751429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55b0697-3b99-4ccc-9879-378846721cec admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.756654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.776270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.776270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.776270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.776270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.776270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.776270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1023/2087] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:06.777396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.789713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bba19e-7b02-4230-99c2-59976ceeee26 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.799789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.800424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.800739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.801530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.802234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.803864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.820683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1065/2088] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:06.825445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.837860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9bd605-4b55-44cf-97d0-801e3a61ff95 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.843287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad79e75b-b518-4124-8aa2-00e2d40765cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.844649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e75b-b518-4124-8aa2-00e2d40765cd admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.845196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e75b-b518-4124-8aa2-00e2d40765cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.845831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad79e75b-b518-4124-8aa2-00e2d40765cd admin admin] PATH_INFO: `/v3/projects/8807c606663d46c2b9b8441aea83def0/users/971862487232469cb7804b86814277c7/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.878549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e75b-b518-4124-8aa2-00e2d40765cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8807c606663d46c2b9b8441aea83def0, user_id=971862487232469cb7804b86814277c7, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.878549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad79e75b-b518-4124-8aa2-00e2d40765cd admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.882677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:06.884510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:06.921444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abc2fc-b9a2-4177-b3a2-beefa7af43bd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:06.922366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:06.923018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.923305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.923587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] PATH_INFO: `/v3/projects/bd60082e4876483ebfe3b4979c8422e6` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:06.924726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd60082e4876483ebfe3b4979c8422e6)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:06.927220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:06.960851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1024/2089] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:06 2022] PUT /identity/v3/projects/8807c606663d46c2b9b8441aea83def0/users/971862487232469cb7804b86814277c7/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:06.967510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17212-a74f-421a-9831-00cfa07990cb None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:06.967983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17212-a74f-421a-9831-00cfa07990cb None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:06.968499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c17212-a74f-421a-9831-00cfa07990cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.003322 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f0c17212-a74f-421a-9831-00cfa07990cb None None] MFA Rules not processed for user `971862487232469cb7804b86814277c7`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:07.004717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f0c17212-a74f-421a-9831-00cfa07990cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:07.059083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd60082e4876483ebfe3b4979c8422e6', 'request_id': 'req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.064552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd60082e4876483ebfe3b4979c8422e6', 'request_id': 'req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.074950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1025/2090] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:07.079856 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c17212-a74f-421a-9831-00cfa07990cb None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:07.158082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c17212-a74f-421a-9831-00cfa07990cb None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:07.170141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd60082e4876483ebfe3b4979c8422e6', 'request_id': 'req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.184745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] The token cache is being invalidate because project bd60082e4876483ebfe3b4979c8422e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:07.185203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.185820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.187381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1066/2091] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:06 2022] DELETE /identity/v3/projects/bd60082e4876483ebfe3b4979c8422e6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:07.191498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:07.193383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:07.225503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:07.226135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:07.226440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:07.226737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.227418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:07.229388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:07.268833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f83aa1-31ee-4f5c-a9e5-591d4e2cfb28 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:07.274408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:07.275378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:07.275729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:07.276006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] PATH_INFO: `/v3/projects/08f96add7b69467eaf920fd5756ebdaf` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.277164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] RBAC: Authorizing `identity:delete_project(project_id=08f96add7b69467eaf920fd5756ebdaf)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:07.279207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:07.332919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1026/2092] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:07 2022] POST /identity/v3/projects => generated 355 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:07.336338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:07.336784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:07.405824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb5541f-c656-48bb-88ed-9957d236e088 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:07.410835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:07.411474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:07.411762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:07.412043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] PATH_INFO: `/v3/users/f5a96d81e78c48dc9eda994985772435` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.413201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5a96d81e78c48dc9eda994985772435)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:07.415153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:07.479253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08f96add7b69467eaf920fd5756ebdaf', 'request_id': 'req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.485095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08f96add7b69467eaf920fd5756ebdaf', 'request_id': 'req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.495421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:07.587634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08f96add7b69467eaf920fd5756ebdaf', 'request_id': 'req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.600923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] The token cache is being invalidate because project 08f96add7b69467eaf920fd5756ebdaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:07.601342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.602186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.603797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1067/2093] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:07 2022] DELETE /identity/v3/projects/08f96add7b69467eaf920fd5756ebdaf => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:07.604788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:07.606111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:07.671822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ae8ab4-50d7-4e93-ad14-f5f5fd4a976b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:07.678213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:07.678925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:07.679267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:07.679554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.680203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:07.682113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:07.683598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5a96d81e78c48dc9eda994985772435'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.684645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5a96d81e78c48dc9eda994985772435'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.771175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:07.774059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5a96d81e78c48dc9eda994985772435'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.780203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1068/2094] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:07 2022] POST /identity/v3/users => generated 284 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:07.780203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:07.780203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:07.789749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5a96d81e78c48dc9eda994985772435'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.793223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6088a5a1-8e29-4feb-a584-378934ebac67 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:07.797942 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3327974a-e41a-4535-af1c-ca43f4af073e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5a96d81e78c48dc9eda994985772435'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.798737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:07.799505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:07.799763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:07.800047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] PATH_INFO: `/v3/users/c5e42d9e8f4a492dbc3ab52786eb0b2e` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.801942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e42d9e8f4a492dbc3ab52786eb0b2e)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:07.804314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:07.805739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1027/2095] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:07 2022] DELETE /identity/v3/users/f5a96d81e78c48dc9eda994985772435 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:07.806818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:07.807115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:07.807440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.830736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:07.833001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:07.899231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1028/2096] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:59:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:07.900639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:07.902024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:07.974242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e42d9e8f4a492dbc3ab52786eb0b2e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.975408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e42d9e8f4a492dbc3ab52786eb0b2e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:07.975992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f809f3-1d56-4cc4-91ef-3bfde5ac7f33 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:07.981854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:07.982545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:07.982868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:07.986810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:07.986810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:07.986810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:07.997119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1029/2097] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:07 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:07.998413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.001148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.049629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e42d9e8f4a492dbc3ab52786eb0b2e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.057919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e42d9e8f4a492dbc3ab52786eb0b2e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.070565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e42d9e8f4a492dbc3ab52786eb0b2e'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.075949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638440ee-df42-4d63-8944-29d0c5d1e70e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:08.077474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1069/2098] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:07 2022] DELETE /identity/v3/users/c5e42d9e8f4a492dbc3ab52786eb0b2e => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:08.078294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.079759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.148858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:08.149627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.150279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.150660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.152746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.159744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e11c4c-7156-4300-a6d4-cf618f4dc2fe admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:08.165911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:08.166557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.167281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.167567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] PATH_INFO: `/v3/users/f15446fb35384395b32d601b313befda` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.169213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=f15446fb35384395b32d601b313befda)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:08.171592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:08.220142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:08.221788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:08.230467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1030/2099] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 06:59:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:59:08.231364 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.232706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.245760 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ca4d4-a115-4777-8d97-682819e99838 service swift] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:08.251573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:08.251573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.251573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.251839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] PATH_INFO: `/v3/users/9f00e8ef143e4218a8a2e31a5fddd869` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.252938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f00e8ef143e4218a8a2e31a5fddd869)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:08.254938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:08.389270 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f15446fb35384395b32d601b313befda'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.390100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f15446fb35384395b32d601b313befda'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.443661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f00e8ef143e4218a8a2e31a5fddd869'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.445628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f00e8ef143e4218a8a2e31a5fddd869'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.467643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f15446fb35384395b32d601b313befda'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.477110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f15446fb35384395b32d601b313befda'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.490927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f15446fb35384395b32d601b313befda'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.497761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1070/2100] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:08 2022] DELETE /identity/v3/users/f15446fb35384395b32d601b313befda => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:08.498687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.500288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.528776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f00e8ef143e4218a8a2e31a5fddd869'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.543939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f00e8ef143e4218a8a2e31a5fddd869'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.552794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f00e8ef143e4218a8a2e31a5fddd869'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.565704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1031/2101] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:08 2022] DELETE /identity/v3/users/9f00e8ef143e4218a8a2e31a5fddd869 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:08.568718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.570145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.580056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ffb3c2-1340-48bc-a751-699c6a6ea2ce admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:08.644943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d11f3c-1bbd-4740-bc51-017363264649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:08.646528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d11f3c-1bbd-4740-bc51-017363264649 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.652109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d11f3c-1bbd-4740-bc51-017363264649 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.652109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d11f3c-1bbd-4740-bc51-017363264649 admin admin] PATH_INFO: `/v3/projects/c3173202a2ce43bebe3ab344985aa265/users/3c23c203e4494b7aaa6474d7d7b38056/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.653614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3278541-780a-463c-972c-731ae4084975 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:08.664705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:08.666588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.667111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.667391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] PATH_INFO: `/v3/projects/60f6e6c0841a4e02a0d838c8e27567f1` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.668647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f6e6c0841a4e02a0d838c8e27567f1)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:08.670608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:08.671387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d11f3c-1bbd-4740-bc51-017363264649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3173202a2ce43bebe3ab344985aa265, user_id=3c23c203e4494b7aaa6474d7d7b38056, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:08.674875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d11f3c-1bbd-4740-bc51-017363264649 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:08.784738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1071/2102] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:08 2022] PUT /identity/v3/projects/c3173202a2ce43bebe3ab344985aa265/users/3c23c203e4494b7aaa6474d7d7b38056/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:08.786172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f041-9f3e-4b40-8e98-ce6076c0ce1d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.786522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f041-9f3e-4b40-8e98-ce6076c0ce1d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.786895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b8f041-9f3e-4b40-8e98-ce6076c0ce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.799550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f6e6c0841a4e02a0d838c8e27567f1', 'request_id': 'req-e9c692cc-2968-4d7a-81ba-9a9138002027'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.806565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f6e6c0841a4e02a0d838c8e27567f1', 'request_id': 'req-e9c692cc-2968-4d7a-81ba-9a9138002027'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.807148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-75b8f041-9f3e-4b40-8e98-ce6076c0ce1d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:08.808458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-75b8f041-9f3e-4b40-8e98-ce6076c0ce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.812684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f6e6c0841a4e02a0d838c8e27567f1', 'request_id': 'req-e9c692cc-2968-4d7a-81ba-9a9138002027'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.870262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1072/2103] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:08.871634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.871921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.872199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.878295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] The token cache is being invalidate because project 60f6e6c0841a4e02a0d838c8e27567f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:08.878701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.880305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:08.883023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1032/2104] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:08 2022] DELETE /identity/v3/projects/60f6e6c0841a4e02a0d838c8e27567f1 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:08.885898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.885898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.893462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:08.894695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.899807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c692cc-2968-4d7a-81ba-9a9138002027 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:08.903191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1073/2105] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:08.905570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:08.906212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.906714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.907336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] PATH_INFO: `/v3/projects/09542283e6eb4fb5a4acc58a0467a807` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.907454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.908692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:08.908885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=09542283e6eb4fb5a4acc58a0467a807)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:08.911394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:08.921217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec62c7a-a7e0-4a2d-8d41-2336fd2a5312 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:08.929754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:08.930404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:08.930693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:08.934137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:08.934137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:08.934137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:08.945937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1074/2106] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:08.946904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:08.950035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.011168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c973028-adf5-4637-a6f3-416c1a0881a3 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:09.016054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:09.016821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.017109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.017408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.019377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.032593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:09.034225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:09.047784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1075/2107] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:09.048850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:09.049932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.070288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ea227-d494-41cf-8e93-24e660441980 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:09.071647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09542283e6eb4fb5a4acc58a0467a807', 'request_id': 'req-f92b0d57-9dd4-41c1-a90f-668c4336d78a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.084931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09542283e6eb4fb5a4acc58a0467a807', 'request_id': 'req-f92b0d57-9dd4-41c1-a90f-668c4336d78a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.094438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09542283e6eb4fb5a4acc58a0467a807', 'request_id': 'req-f92b0d57-9dd4-41c1-a90f-668c4336d78a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.128225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:09.128863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.129195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.129581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] PATH_INFO: `/v3/users/06ef105beb4449c5a451463987a68daa` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.131275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06ef105beb4449c5a451463987a68daa)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:09.133212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:09.186491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] The token cache is being invalidate because project 09542283e6eb4fb5a4acc58a0467a807 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:09.186812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.187477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.189010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1033/2108] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:08 2022] DELETE /identity/v3/projects/09542283e6eb4fb5a4acc58a0467a807 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:09.189929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:09.191367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.244873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:09.249448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b0d57-9dd4-41c1-a90f-668c4336d78a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:09.253282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:09.253904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.254287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.254540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.256543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.269297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:09.270810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:09.288051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1034/2109] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:09.288870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:09.290156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.307610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd10758c-9ab8-4b1e-93ea-bc3f10e58f69 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:09.307610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09561b9f-8ee5-4a6d-8008-8c7b3b62e13d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:09.307996 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561b9f-8ee5-4a6d-8008-8c7b3b62e13d admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.308282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561b9f-8ee5-4a6d-8008-8c7b3b62e13d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.308558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09561b9f-8ee5-4a6d-8008-8c7b3b62e13d admin admin] PATH_INFO: `/v3/projects/c3173202a2ce43bebe3ab344985aa265/users/3c23c203e4494b7aaa6474d7d7b38056/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.310521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09561b9f-8ee5-4a6d-8008-8c7b3b62e13d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3173202a2ce43bebe3ab344985aa265, user_id=3c23c203e4494b7aaa6474d7d7b38056, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:09.313212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09561b9f-8ee5-4a6d-8008-8c7b3b62e13d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:09.324061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1035/2110] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:09 2022] PUT /identity/v3/projects/c3173202a2ce43bebe3ab344985aa265/users/3c23c203e4494b7aaa6474d7d7b38056/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:09.325299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80a887-b10b-49b0-a3e4-c95004d4294f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.325906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80a887-b10b-49b0-a3e4-c95004d4294f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.325906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b80a887-b10b-49b0-a3e4-c95004d4294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.368026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7b80a887-b10b-49b0-a3e4-c95004d4294f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:09.369604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7b80a887-b10b-49b0-a3e4-c95004d4294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.439187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1036/2111] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:09.443844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06ef105beb4449c5a451463987a68daa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.444912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06ef105beb4449c5a451463987a68daa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.447233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9332d71-18ef-4a70-ae68-6585f2d60424 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.447739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9332d71-18ef-4a70-ae68-6585f2d60424 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.447837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9332d71-18ef-4a70-ae68-6585f2d60424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.455262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:09.471372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e9332d71-18ef-4a70-ae68-6585f2d60424 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:09.472614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e9332d71-18ef-4a70-ae68-6585f2d60424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.521031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06ef105beb4449c5a451463987a68daa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.536598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1037/2112] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 06:59:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:09.538151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.538616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.538887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.542378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06ef105beb4449c5a451463987a68daa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.579990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] MFA Rules not processed for user `3c23c203e4494b7aaa6474d7d7b38056`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:09.581390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.593428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6bd35524-d763-4bd5-8a28-894498134d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06ef105beb4449c5a451463987a68daa'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.602487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1076/2113] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:09 2022] DELETE /identity/v3/users/06ef105beb4449c5a451463987a68daa => generated 0 bytes in 554 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:09.603918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.606382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.606382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.638104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:09.639406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.702086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1038/2114] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:09 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:09.703003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:09.704545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.724249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64760baa-97de-408d-8ace-cb222db0b128 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:09.732593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:09.732950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1077/2115] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:09.734340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:09.734656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.737272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.737272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] PATH_INFO: `/v3/projects/56ef9ea45ffe42db8b7a3a0bd3ed287c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.737272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56ef9ea45ffe42db8b7a3a0bd3ed287c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:09.738481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:09.738901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:09.839212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdd9984-ab49-4acd-9d69-6931a9d4b306 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:09.850884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56ef9ea45ffe42db8b7a3a0bd3ed287c', 'request_id': 'req-2175336d-09d7-435c-89b6-7c0b8b336208'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.855919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56ef9ea45ffe42db8b7a3a0bd3ed287c', 'request_id': 'req-2175336d-09d7-435c-89b6-7c0b8b336208'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.868026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56ef9ea45ffe42db8b7a3a0bd3ed287c', 'request_id': 'req-2175336d-09d7-435c-89b6-7c0b8b336208'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.940504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:09.941563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:09.941854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:09.942644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:09.947680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] The token cache is being invalidate because project 56ef9ea45ffe42db8b7a3a0bd3ed287c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:09.948639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.948816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:09.950488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1039/2116] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:09 2022] DELETE /identity/v3/projects/56ef9ea45ffe42db8b7a3a0bd3ed287c => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:09.951532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:09.953610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.010015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.011692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.021332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1078/2117] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 06:59:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:59:10.028513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.038518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175336d-09d7-435c-89b6-7c0b8b336208 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.042497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d786caa-82ee-47b1-be88-8575b54627b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.048742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d786caa-82ee-47b1-be88-8575b54627b7 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.048742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d786caa-82ee-47b1-be88-8575b54627b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.048742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d786caa-82ee-47b1-be88-8575b54627b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.048742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2d786caa-82ee-47b1-be88-8575b54627b7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.095625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4b82e3-2c28-484e-9ebb-907ec599e95c service swift] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.102046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.102753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.103421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.103616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.105776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:10.106428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.108070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.118106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d786caa-82ee-47b1-be88-8575b54627b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.119662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d786caa-82ee-47b1-be88-8575b54627b7 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.120883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1079/2118] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:10.121568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.123508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.130681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1040/2119] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:09 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:10.132105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.132400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.132676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.137418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26031e0e-5b8b-4dff-a795-5cb2b7d48df2 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.144125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.144767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.145055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.145419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] PATH_INFO: `/v3/projects/a55a3b843caf4312a0d697970d9d3098` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.147617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a55a3b843caf4312a0d697970d9d3098)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.150609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.154951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:10.155559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.170749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1041/2120] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:10.170749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.170749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.171194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:10.180321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f48f9c6-bbff-4435-8fdc-306628710a11 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.186162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.186854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.187135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.187405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] PATH_INFO: `/v3/projects/073219a511e64679a7c545942b181e8a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.188559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=073219a511e64679a7c545942b181e8a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.190465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.274243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a55a3b843caf4312a0d697970d9d3098', 'request_id': 'req-69f43fab-b9dc-4975-95bb-441884f16d69'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.279801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a55a3b843caf4312a0d697970d9d3098', 'request_id': 'req-69f43fab-b9dc-4975-95bb-441884f16d69'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.358620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a55a3b843caf4312a0d697970d9d3098', 'request_id': 'req-69f43fab-b9dc-4975-95bb-441884f16d69'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.375807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] The token cache is being invalidate because project a55a3b843caf4312a0d697970d9d3098 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:10.376110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.376804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.378144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '073219a511e64679a7c545942b181e8a', 'request_id': 'req-238f08c0-2b10-4e4a-a553-a5be286ca190'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.379045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1080/2121] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:10 2022] DELETE /identity/v3/projects/a55a3b843caf4312a0d697970d9d3098 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:10.379614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.382660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.385833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '073219a511e64679a7c545942b181e8a', 'request_id': 'req-238f08c0-2b10-4e4a-a553-a5be286ca190'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.391725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '073219a511e64679a7c545942b181e8a', 'request_id': 'req-238f08c0-2b10-4e4a-a553-a5be286ca190'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.449332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f43fab-b9dc-4975-95bb-441884f16d69 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.473472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] The token cache is being invalidate because project 073219a511e64679a7c545942b181e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:10.474154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.475522 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-238f08c0-2b10-4e4a-a553-a5be286ca190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.477388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1042/2122] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:10 2022] DELETE /identity/v3/projects/073219a511e64679a7c545942b181e8a => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:10.478411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.478707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.479038 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.500117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:10.501380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.519774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.520315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.520627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.521029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.521572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.523592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.568171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1043/2123] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:10.569180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.570515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.619596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1081/2124] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:10 2022] POST /identity/v3/projects => generated 359 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:10.620768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.623181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.633064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7773e13-8ef2-4855-8d10-5eb70a9933e9 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.643406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:10.683212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba159167-83f4-494d-8677-f29ccfeafd6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.683821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159167-83f4-494d-8677-f29ccfeafd6b service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.684106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159167-83f4-494d-8677-f29ccfeafd6b service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.684379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba159167-83f4-494d-8677-f29ccfeafd6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.686123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ba159167-83f4-494d-8677-f29ccfeafd6b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.689987 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036b7ba-31b0-4c5b-91b8-25b5784b24a1 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.695601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.696437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.696690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.696976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] PATH_INFO: `/v3/users/e72fee76c3c2403a98645af8094be17b` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.698141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e72fee76c3c2403a98645af8094be17b)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.700164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.751004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba159167-83f4-494d-8677-f29ccfeafd6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.752494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba159167-83f4-494d-8677-f29ccfeafd6b service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.762045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1044/2125] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:10 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:10.763318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f55b08-2ace-4f25-acb8-f8d4de5b6417 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.763612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f55b08-2ace-4f25-acb8-f8d4de5b6417 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.763894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f55b08-2ace-4f25-acb8-f8d4de5b6417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.784018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-77f55b08-2ace-4f25-acb8-f8d4de5b6417 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:10.785249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-77f55b08-2ace-4f25-acb8-f8d4de5b6417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.793836 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1045/2126] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:10.794653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f55b08-2ace-4f25-acb8-f8d4de5b6417 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.804609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f55b08-2ace-4f25-acb8-f8d4de5b6417 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.809561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.810175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.810454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.810727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.811404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:10.811713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.813388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.825397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1046/2127] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:10.826369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:10.830332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:10.840835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34256c7-9445-4c64-8e8a-d4e54ea43073 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:10.845659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bcf46a-1ba4-422e-9cdd-3cb5b25719f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:10.846257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcf46a-1ba4-422e-9cdd-3cb5b25719f6 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.846546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcf46a-1ba4-422e-9cdd-3cb5b25719f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.846866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bcf46a-1ba4-422e-9cdd-3cb5b25719f6 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.847499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcf46a-1ba4-422e-9cdd-3cb5b25719f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:10.849536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bcf46a-1ba4-422e-9cdd-3cb5b25719f6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:10.932719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:10.940665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1047/2128] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:10 2022] POST /identity/v3/users => generated 280 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:10.941975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c69dea-57b1-4968-ac19-a572ed1063e5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:10.942283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c69dea-57b1-4968-ac19-a572ed1063e5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:10.943069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c69dea-57b1-4968-ac19-a572ed1063e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:10.947042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e72fee76c3c2403a98645af8094be17b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.947474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e72fee76c3c2403a98645af8094be17b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:10.973387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-48c69dea-57b1-4968-ac19-a572ed1063e5 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:10.974788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-48c69dea-57b1-4968-ac19-a572ed1063e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:11.016983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e72fee76c3c2403a98645af8094be17b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:11.026604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e72fee76c3c2403a98645af8094be17b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:11.035824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1048/2129] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:59:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:11.041251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e72fee76c3c2403a98645af8094be17b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:11.047141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.047141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.047141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.048751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1082/2130] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:10 2022] DELETE /identity/v3/users/e72fee76c3c2403a98645af8094be17b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:11.049739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.051185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:11.072040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:11.073593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:11.139845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9cd12-bb40-45a7-b1bd-0a593983e4b8 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.146105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.146707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.147303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.147751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.148413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.150828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.155358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1049/2131] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:11.155934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.157716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:11.179233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2507a7d-9cf9-475f-b298-7e1020c19c0b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.180086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.180841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.181126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.181431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.182092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.184401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.195694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1050/2132] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:11.196559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.199635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:11.279538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d6cd90-b9bf-4b55-9d54-e38af63d289a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.284792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.285413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.285695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.285985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.298554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1083/2133] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:11 2022] POST /identity/v3/projects => generated 375 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:11.299423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.354736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.356785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.366581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1051/2134] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 06:59:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:59:11.368058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.369521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432813f-6913-4dcc-af67-289dc69f3998 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.379245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.380061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.380560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.380665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca28c24-4119-4548-85eb-4bf1a04a016a service swift] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.380746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.381764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:11.381902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.383752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.386416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.387376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.387376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.388049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.388520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.390116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.399042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1084/2135] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:11.400225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.402074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1052/2136] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:11.404327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.415082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1887177-ee02-4f23-adb0-7559604fcf08 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.417172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ce9e0a-1189-4f2e-b7ac-56bb4cb477f1 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.423631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.423823 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.423935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.427962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.428112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.428223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.428313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.428400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.428400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.428567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.428567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.428753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.568861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1053/2137] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:11 2022] POST /identity/v3/projects => generated 383 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:11.569707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.573841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1085/2138] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:11 2022] POST /identity/v3/users => generated 288 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:11.573841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.583260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9018bf9-2eee-4f59-ad65-47c6d26f438a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.640871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2dd86a-3f6d-4a60-859c-03322dcd6272 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.646304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.647174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.647475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.647831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] PATH_INFO: `/v3/projects/1e046ddb8c5040189add3b7a8fa4938f/users/50fbcc9fc6614bb1b5fcaae10e70097f/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.651114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.652511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.652511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.652511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.653109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.655016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.666590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e046ddb8c5040189add3b7a8fa4938f, user_id=50fbcc9fc6614bb1b5fcaae10e70097f, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.669653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.754078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1054/2139] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:11 2022] PUT /identity/v3/projects/1e046ddb8c5040189add3b7a8fa4938f/users/50fbcc9fc6614bb1b5fcaae10e70097f/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:11.754936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.760593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1086/2140] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:11 2022] POST /identity/v3/users => generated 292 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:11.760593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.763334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:11.775929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483252f9-0c48-49f8-9c00-196a16e310dc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.826836 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ebbdb-7190-4511-ae37-411b769375ad admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.831969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.832369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.834717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.834717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.834717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.835784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.836322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.836977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.837267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.837746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] PATH_INFO: `/v3/projects/f0f532fc77b54e9bbeaffbf0a875295b` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.838832 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f532fc77b54e9bbeaffbf0a875295b)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.840759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.854611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1055/2141] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:11.854611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:11.866382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e56ebdd-6ecf-4eaa-9c48-f61d68e64896 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:11.877843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b90f09-0879-47e8-b1f5-7a35a29a407e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:11.877843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90f09-0879-47e8-b1f5-7a35a29a407e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.877843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90f09-0879-47e8-b1f5-7a35a29a407e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.877843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b90f09-0879-47e8-b1f5-7a35a29a407e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.878257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b90f09-0879-47e8-b1f5-7a35a29a407e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:11.878257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b90f09-0879-47e8-b1f5-7a35a29a407e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:11.891192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1056/2142] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:11.892567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645f222-57b5-4be9-a3e0-5c3f80d71f5f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:11.892934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645f222-57b5-4be9-a3e0-5c3f80d71f5f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:11.893130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0645f222-57b5-4be9-a3e0-5c3f80d71f5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:11.928433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0645f222-57b5-4be9-a3e0-5c3f80d71f5f None None] MFA Rules not processed for user `50fbcc9fc6614bb1b5fcaae10e70097f`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:11.928433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0645f222-57b5-4be9-a3e0-5c3f80d71f5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:11.992446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f532fc77b54e9bbeaffbf0a875295b', 'request_id': 'req-41fd7e83-fc3f-459a-9c14-39f3b567593b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:11.998663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f532fc77b54e9bbeaffbf0a875295b', 'request_id': 'req-41fd7e83-fc3f-459a-9c14-39f3b567593b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:11.998802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1057/2143] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:11 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:12.004118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645f222-57b5-4be9-a3e0-5c3f80d71f5f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.017208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0645f222-57b5-4be9-a3e0-5c3f80d71f5f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.082173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.082798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.083620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.083904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.084570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.086160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.096401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1058/2144] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:12.096757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f532fc77b54e9bbeaffbf0a875295b', 'request_id': 'req-41fd7e83-fc3f-459a-9c14-39f3b567593b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.103314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.108080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b38b0b7-2cd2-48cd-bbc0-b6f4a0c4e5ca admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.112479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] The token cache is being invalidate because project f0f532fc77b54e9bbeaffbf0a875295b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:12.112923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.113325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.113603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.114066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.114446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.114886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.115670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.117756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.119292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1087/2145] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:11 2022] DELETE /identity/v3/projects/f0f532fc77b54e9bbeaffbf0a875295b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:12.120234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.122091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.131678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1059/2146] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:12.131678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.132535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.144838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05587730-a944-4e92-ad9d-20004eef531e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.158812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a152e7b-484b-4490-b99d-0b1c80dbefdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.159496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152e7b-484b-4490-b99d-0b1c80dbefdb admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.160028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152e7b-484b-4490-b99d-0b1c80dbefdb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.160028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a152e7b-484b-4490-b99d-0b1c80dbefdb admin admin] PATH_INFO: `/v3/projects/41c7142c6380441f9a88283c50ac2b00/users/71e3c97afe074a7eb129b468c9740130/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.177997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a152e7b-484b-4490-b99d-0b1c80dbefdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c7142c6380441f9a88283c50ac2b00, user_id=71e3c97afe074a7eb129b468c9740130, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.180894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a152e7b-484b-4490-b99d-0b1c80dbefdb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.194078 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:12.198357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fd7e83-fc3f-459a-9c14-39f3b567593b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.202299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d9b310-efc1-4d8a-8d33-343fdc685734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.202955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b310-efc1-4d8a-8d33-343fdc685734 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.203241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b310-efc1-4d8a-8d33-343fdc685734 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.203519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d9b310-efc1-4d8a-8d33-343fdc685734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.208326 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-67d9b310-efc1-4d8a-8d33-343fdc685734 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.245711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1060/2147] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:12 2022] PUT /identity/v3/projects/41c7142c6380441f9a88283c50ac2b00/users/71e3c97afe074a7eb129b468c9740130/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:12.247238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.247628 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.247954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.271581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9b310-efc1-4d8a-8d33-343fdc685734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.273097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d9b310-efc1-4d8a-8d33-343fdc685734 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.279758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:12.280977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.290193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1088/2148] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:12.291518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8014-c42a-4ed9-abef-e487d3b00dd1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.291802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8014-c42a-4ed9-abef-e487d3b00dd1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.292130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ee8014-c42a-4ed9-abef-e487d3b00dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.315624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f0ee8014-c42a-4ed9-abef-e487d3b00dd1 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:12.316848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f0ee8014-c42a-4ed9-abef-e487d3b00dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.377082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1061/2149] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:12.377929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.379421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.392722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8132d8b1-0a08-4cdb-9b2b-d4765f07ef5a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.398466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e284df51-c016-47c4-8f37-8061105707ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.399173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284df51-c016-47c4-8f37-8061105707ce admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.399455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284df51-c016-47c4-8f37-8061105707ce admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.399759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e284df51-c016-47c4-8f37-8061105707ce admin admin] PATH_INFO: `/v3/projects/97e6b803ada9499297d007070eab67c4/users/197fd6403f79469bb77de153f4fd9ede/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.401388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1089/2150] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 06:59:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:12.402670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.403231 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.403498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.421297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284df51-c016-47c4-8f37-8061105707ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e6b803ada9499297d007070eab67c4, user_id=197fd6403f79469bb77de153f4fd9ede, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.424337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e284df51-c016-47c4-8f37-8061105707ce admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.433844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] MFA Rules not processed for user `71e3c97afe074a7eb129b468c9740130`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:12.435109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.498913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1090/2151] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:12.499684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.501160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.506028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:12.509693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1062/2152] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:12 2022] PUT /identity/v3/projects/97e6b803ada9499297d007070eab67c4/users/197fd6403f79469bb77de153f4fd9ede/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:12.511268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.511525 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.512040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.517490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d204739-0669-40ce-8839-d1cf6f462afe None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.535759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:12.536982 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.575300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.575947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.576234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.576514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] PATH_INFO: `/v3/users/50fbcc9fc6614bb1b5fcaae10e70097f` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.577674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50fbcc9fc6614bb1b5fcaae10e70097f)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.579754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.600618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1063/2153] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:12.602068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.603441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.679847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e065b-3129-4db2-84ef-56c703125b3a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.687246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.688107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.688456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.688565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.747505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50fbcc9fc6614bb1b5fcaae10e70097f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.748213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50fbcc9fc6614bb1b5fcaae10e70097f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.763770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.765307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.774216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1064/2154] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 06:59:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 06:59:12.775127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.779572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.827581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50fbcc9fc6614bb1b5fcaae10e70097f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.834687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bf1f22-2ec7-4156-9da3-b956ea63993f service swift] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.836052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50fbcc9fc6614bb1b5fcaae10e70097f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.838486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:12.839137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.839420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.839700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.841483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.848221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f10e4498-0546-4591-a8c9-598eca5156f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50fbcc9fc6614bb1b5fcaae10e70097f'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:12.858847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1091/2155] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:12 2022] DELETE /identity/v3/users/50fbcc9fc6614bb1b5fcaae10e70097f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:12.861624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421f85e-92ea-4866-af09-46f7f5220eb3 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.862214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421f85e-92ea-4866-af09-46f7f5220eb3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.862614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421f85e-92ea-4866-af09-46f7f5220eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.891732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d421f85e-92ea-4866-af09-46f7f5220eb3 None None] MFA Rules not processed for user `197fd6403f79469bb77de153f4fd9ede`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:12.892972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d421f85e-92ea-4866-af09-46f7f5220eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.907698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:12.909147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:12.919120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1065/2156] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:12.919989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:12.921434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:12.936610 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3e6538-da56-4456-9c59-a119186d0493 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:12.968856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1092/2157] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:12.972788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519011-349f-49d5-8606-1a2eae808797 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:12.972788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519011-349f-49d5-8606-1a2eae808797 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:12.972788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c519011-349f-49d5-8606-1a2eae808797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:12.985428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:12.992532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0c519011-349f-49d5-8606-1a2eae808797 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:12.993806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0c519011-349f-49d5-8606-1a2eae808797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:13.005955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.006713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.007099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.007446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.008173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:13.008544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.010436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.034565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1066/2158] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:13.034565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.037424 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:13.051616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142106c4-61cb-4d54-95a9-5d37f4aff250 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.057805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.058494 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.058740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.059048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.059679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.061623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.071406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:13.084946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1093/2159] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:13.088868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519011-349f-49d5-8606-1a2eae808797 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.098788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c519011-349f-49d5-8606-1a2eae808797 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.103742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.109305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.109305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.109305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.109305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.109305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.168063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1067/2160] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:13.169468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.172006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:13.234585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1094/2161] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:13.234585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.239762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef04f08-9f43-4063-998d-1a194956173c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.298680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:13.308660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.309323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.309606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.309885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.312812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b694cc27-acb8-4a47-be86-3fd591a5f86e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.317818 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.319046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.319329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.319604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.320237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.321966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.322173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.323818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.337734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1068/2162] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:13.339638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.357657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b71799-c0d6-4c22-b965-93855b5f64e0 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.360870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.361560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.361910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.362256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.363006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.365607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.439531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1095/2163] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:13.440690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.453550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d75be-65f2-4407-a2d6-1f556d067c7b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.455480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:13.461451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.462819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1069/2164] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:13.465424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.465834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.465946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.466853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.467693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.469810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.480209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c1e283-688c-4b8e-a43d-a3be72cbb8a7 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.484508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1096/2165] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:13.490451 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.490991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.491670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.492098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.492372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.493295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.495012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.509425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1070/2166] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:13.511694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1ab061-df27-404c-a10f-db51a5255272 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.513867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.520040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.520769 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.521267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.521675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.522979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.525106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.531117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d9fe98-7053-4771-abc3-d23345798dde admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.537436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1097/2167] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:13.541716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.553265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5b57d-2b4b-4282-b983-0ad636c41e8e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.558214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.559053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.559410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.559599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.560258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.561862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.570894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9676665-a016-4cd1-83ab-96a1863c6d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.572780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676665-a016-4cd1-83ab-96a1863c6d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.572780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676665-a016-4cd1-83ab-96a1863c6d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.572780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9676665-a016-4cd1-83ab-96a1863c6d83 admin admin] PATH_INFO: `/v3/projects/75def8f9bf144245b120be8a2bf9d7cf/users/949b1ffc71c54a55a8dca7a6a1fbb594/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.575760 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1071/2168] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:13.579723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.592415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c111c161-179a-464a-a1c8-e2816500da5a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.597909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676665-a016-4cd1-83ab-96a1863c6d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75def8f9bf144245b120be8a2bf9d7cf, user_id=949b1ffc71c54a55a8dca7a6a1fbb594, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.598367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50408858-f415-4bc4-878a-6e09a5b865a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.599782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50408858-f415-4bc4-878a-6e09a5b865a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.606823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50408858-f415-4bc4-878a-6e09a5b865a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.606823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50408858-f415-4bc4-878a-6e09a5b865a2 admin admin] PATH_INFO: `/v3/projects/9f84e43e801b4cdfa05f095844cf013a/users/54766892eda44f5395a5cd6aa2035634/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.607471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9676665-a016-4cd1-83ab-96a1863c6d83 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.633864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50408858-f415-4bc4-878a-6e09a5b865a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f84e43e801b4cdfa05f095844cf013a, user_id=54766892eda44f5395a5cd6aa2035634, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.637486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50408858-f415-4bc4-878a-6e09a5b865a2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:13.681949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1098/2169] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:13 2022] PUT /identity/v3/projects/75def8f9bf144245b120be8a2bf9d7cf/users/949b1ffc71c54a55a8dca7a6a1fbb594/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:13.695355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ef18-0cab-4bcc-ad01-e1cd5a2f2b96 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.696174 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ef18-0cab-4bcc-ad01-e1cd5a2f2b96 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.696622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d08ef18-0cab-4bcc-ad01-e1cd5a2f2b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.718347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1072/2170] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:13 2022] PUT /identity/v3/projects/9f84e43e801b4cdfa05f095844cf013a/users/54766892eda44f5395a5cd6aa2035634/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:13.719989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf84f5-90d0-450a-90f1-9205bbb3481d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.720329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf84f5-90d0-450a-90f1-9205bbb3481d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.720603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcf84f5-90d0-450a-90f1-9205bbb3481d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.774387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0bcf84f5-90d0-450a-90f1-9205bbb3481d None None] MFA Rules not processed for user `54766892eda44f5395a5cd6aa2035634`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:13.775819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0bcf84f5-90d0-450a-90f1-9205bbb3481d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:13.789088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:13.792867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6d08ef18-0cab-4bcc-ad01-e1cd5a2f2b96 None None] MFA Rules not processed for user `949b1ffc71c54a55a8dca7a6a1fbb594`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:13.794233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6d08ef18-0cab-4bcc-ad01-e1cd5a2f2b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:13.883876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1073/2171] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:13.884908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf84f5-90d0-450a-90f1-9205bbb3481d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.906623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1099/2172] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:13.911164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ef18-0cab-4bcc-ad01-e1cd5a2f2b96 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:13.973566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcf84f5-90d0-450a-90f1-9205bbb3481d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:13.991889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:13.992835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:13.993274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:13.993692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:13.994589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:13.998801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.029869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d08ef18-0cab-4bcc-ad01-e1cd5a2f2b96 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.034876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.035496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.035782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.036135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.037293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.039279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.097248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1074/2173] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/projects => generated 387 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:14.097248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.097248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:14.111889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:14.128145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1100/2174] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:13 2022] POST /identity/v3/projects => generated 383 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:14.129251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.184081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f74a06-00db-4787-a163-65f01e84b9c9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.221626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1616f35a-8384-48f6-91ba-f9c750893d44 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.232035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.232824 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.233116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.233396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.234039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.236042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.261286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.261984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.262337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.262539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] PATH_INFO: `/v3/projects/1e046ddb8c5040189add3b7a8fa4938f` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.263798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e046ddb8c5040189add3b7a8fa4938f)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.265841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.377557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:14.383033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1101/2175] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:14 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:14.383585 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.395095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4de195-b3bd-420d-b004-8edcc9c07ddc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.409779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e046ddb8c5040189add3b7a8fa4938f', 'request_id': 'req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:14.419698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e046ddb8c5040189add3b7a8fa4938f', 'request_id': 'req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:14.426809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e046ddb8c5040189add3b7a8fa4938f', 'request_id': 'req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:14.449564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:14.463921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.464541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.464825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.465107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.465747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.467730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.507924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] The token cache is being invalidate because project 1e046ddb8c5040189add3b7a8fa4938f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:14.508217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:14.508946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:14.510599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1075/2176] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:14 2022] DELETE /identity/v3/projects/1e046ddb8c5040189add3b7a8fa4938f => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:14.511489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.512801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:14.525974 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d53dc5-21ae-4f84-ac9b-44f7aeabe74b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.531395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0426804f-8ce7-4a22-80e9-5a1b4dad032d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.532007 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426804f-8ce7-4a22-80e9-5a1b4dad032d admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.532292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426804f-8ce7-4a22-80e9-5a1b4dad032d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.532595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0426804f-8ce7-4a22-80e9-5a1b4dad032d admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.533251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426804f-8ce7-4a22-80e9-5a1b4dad032d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.535047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0426804f-8ce7-4a22-80e9-5a1b4dad032d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.548103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1076/2177] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:14.548103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8081d75-3277-4c48-a005-89ade8fd998d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.548103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8081d75-3277-4c48-a005-89ade8fd998d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.548103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8081d75-3277-4c48-a005-89ade8fd998d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.566304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a8081d75-3277-4c48-a005-89ade8fd998d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:14.567577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a8081d75-3277-4c48-a005-89ade8fd998d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:14.579099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1077/2178] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:14.580236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8081d75-3277-4c48-a005-89ade8fd998d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.591163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8081d75-3277-4c48-a005-89ade8fd998d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.597967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289cb5e6-d851-4333-93fe-09ef51872984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.598604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cb5e6-d851-4333-93fe-09ef51872984 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.598953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cb5e6-d851-4333-93fe-09ef51872984 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.599267 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289cb5e6-d851-4333-93fe-09ef51872984 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.599930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cb5e6-d851-4333-93fe-09ef51872984 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.601563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289cb5e6-d851-4333-93fe-09ef51872984 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.612800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1078/2179] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:14.613822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.614114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.614396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.630014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1102/2180] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:14 2022] POST /identity/v3/users => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:14.632392 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.644405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aae98d-e74c-4b0e-a48c-5fa5a5bffd6c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.651830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.652880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.653311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.653619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] PATH_INFO: `/v3/projects/93740c3264d247a6a95ed15d1f0e340c/users/98279bfc1f5d40b091f465af1b88e99e/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.653810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:14.656081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:14.666083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1079/2181] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:14.667353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.668162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:14.676331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=93740c3264d247a6a95ed15d1f0e340c, user_id=98279bfc1f5d40b091f465af1b88e99e, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.680994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.681918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c8bd31-3917-4371-ad53-e273c3f18a01 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.689706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.690737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.691421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.693676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.695809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.699358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.729095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1080/2182] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:14 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:14.730340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.763019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce00863-75c2-4975-b1c7-6d7f1bf12427 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.776021 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1103/2183] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:14 2022] PUT /identity/v3/projects/93740c3264d247a6a95ed15d1f0e340c/users/98279bfc1f5d40b091f465af1b88e99e/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:14.788516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:14.887195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52458058-be16-4f23-9079-c3040c4d939d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.888014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458058-be16-4f23-9079-c3040c4d939d admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.892928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458058-be16-4f23-9079-c3040c4d939d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.893072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9cf1de-6ec1-4607-ae87-37b5846734cb admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:14.893168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52458058-be16-4f23-9079-c3040c4d939d admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.893168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52458058-be16-4f23-9079-c3040c4d939d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:14.893168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52458058-be16-4f23-9079-c3040c4d939d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.893168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52458058-be16-4f23-9079-c3040c4d939d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.894005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:14.894683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.895028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.895361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] PATH_INFO: `/v3/projects/4df34531b02744e69193e145034777f9/users/592b2125c6644975a399a5169de55955/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.910150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1081/2184] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:14.910150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c0bb5-7502-4b31-aca8-12987d8947fd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:14.910150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c0bb5-7502-4b31-aca8-12987d8947fd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:14.910150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c0bb5-7502-4b31-aca8-12987d8947fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:14.923038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df34531b02744e69193e145034777f9, user_id=592b2125c6644975a399a5169de55955, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:14.925914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:14.928206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:14.939696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b88c0bb5-7502-4b31-aca8-12987d8947fd None None] MFA Rules not processed for user `98279bfc1f5d40b091f465af1b88e99e`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:14.941015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b88c0bb5-7502-4b31-aca8-12987d8947fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:15.006393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1104/2185] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:14 2022] PUT /identity/v3/projects/4df34531b02744e69193e145034777f9/users/592b2125c6644975a399a5169de55955/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:15.007674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.014897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1082/2186] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:14 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:15.014897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c0bb5-7502-4b31-aca8-12987d8947fd None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.031484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c0bb5-7502-4b31-aca8-12987d8947fd None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.083150 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97302b6-b40a-4b5a-aabc-e38e2cbeea6c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.088728 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.089381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.089663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.089928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.090547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.091793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.092408 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.092510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.092704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.092957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.093604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.095253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.105670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1083/2187] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:15.106718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.118502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b7b65-3147-414a-a773-79334569c4b2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.123520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.124058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.124336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.124613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.125392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.127392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.298887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1105/2188] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:15 2022] POST /identity/v3/projects => generated 373 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:15.299085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1084/2189] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:15 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:15.299180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.299254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.355771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0249beb-ffba-48ec-83f0-2fad99ee31e7 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.360104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4e460-cd49-4bcc-8856-28a15cb01a5a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.360934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.361590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.361867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.367019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] PATH_INFO: `/v3/projects/4df34531b02744e69193e145034777f9/users/592b2125c6644975a399a5169de55955/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.367019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4df34531b02744e69193e145034777f9, user_id=592b2125c6644975a399a5169de55955, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.367218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be08dfb-e882-4447-95c8-3326f0067af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.367218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08dfb-e882-4447-95c8-3326f0067af1 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.367218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08dfb-e882-4447-95c8-3326f0067af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.367218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be08dfb-e882-4447-95c8-3326f0067af1 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.367509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be08dfb-e882-4447-95c8-3326f0067af1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.367580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.369300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be08dfb-e882-4447-95c8-3326f0067af1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.378044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1106/2190] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:15 2022] PUT /identity/v3/projects/4df34531b02744e69193e145034777f9/users/592b2125c6644975a399a5169de55955/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:15.380634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.446546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ce865e-7b8f-42e4-8301-c5730895fa11 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.451476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.452091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.452377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.452653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.453286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.455288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.473359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:15.508935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1085/2191] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:15 2022] POST /identity/v3/users => generated 287 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:15.510053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab17e5-ef5d-43d2-ad93-7988ff748c26 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.510330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab17e5-ef5d-43d2-ad93-7988ff748c26 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.510666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ab17e5-ef5d-43d2-ad93-7988ff748c26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.539185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1107/2192] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:15 2022] POST /identity/v3/users => generated 299 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:15.539185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.540508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-05ab17e5-ef5d-43d2-ad93-7988ff748c26 None None] MFA Rules not processed for user `592b2125c6644975a399a5169de55955`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:15.541087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-05ab17e5-ef5d-43d2-ad93-7988ff748c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:15.549380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c88b7a9-07db-4594-ba6a-ed0f9d6c22e1 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.554655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.555293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.555575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.555847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.556606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.558094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.568507 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1108/2193] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:15.572368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.583239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61054ee2-2ae4-4e33-9fa9-0c6ad74e1a47 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.588690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.589291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.589575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.589850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.590495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.592137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.602794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1109/2194] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:15.603774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.613793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3648b8-7d9d-4d59-93fe-c6da763a26d4 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.619658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.620269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.625110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1086/2195] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:15.625631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.625631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.625781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab17e5-ef5d-43d2-ad93-7988ff748c26 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.625854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.625854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.643654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1110/2196] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:15.643654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.644018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ab17e5-ef5d-43d2-ad93-7988ff748c26 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.644185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:15.644302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.644302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.644302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.644302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] PATH_INFO: `/v3/projects/cdcf8c4ebf2b45d3ba527fde49c5f247/users/d13b37838e8e45fbae6b9e26dcaf1d92/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.665137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcf8c4ebf2b45d3ba527fde49c5f247, user_id=d13b37838e8e45fbae6b9e26dcaf1d92, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.670823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.699419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32feb37-5510-46db-ae36-de73d411e45c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.703477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.705403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.705403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.705403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.706674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:15.770103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.771978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1087/2197] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:15 2022] PUT /identity/v3/projects/cdcf8c4ebf2b45d3ba527fde49c5f247/users/d13b37838e8e45fbae6b9e26dcaf1d92/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:15.772193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.772835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.782729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1111/2198] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:15.783632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.796367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb160e-8deb-44c0-be62-0cd4ef913b4f service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.879774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f05839-d948-4154-8e56-f18ff93043a3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.899303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.899303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.899303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.899303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] PATH_INFO: `/v3/projects/a782875bb3a14514820490abf56cbaef/users/7967c4a703de466b8910721bb8746257/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.914242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.916099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.916418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.916703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.917380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.919733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.931687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a782875bb3a14514820490abf56cbaef, user_id=7967c4a703de466b8910721bb8746257, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.937917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:15.955066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1112/2199] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:15 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:15.955066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:15.956886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:15.957128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:15.980816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8225-84b0-4278-a22d-b08e16b41d32 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:15.989334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:15.991126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:15.991126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:15.991374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] PATH_INFO: `/v3/users/f9a224f37eaf4bfa9985f9064b860295` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:15.992988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9a224f37eaf4bfa9985f9064b860295)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:15.994991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.028145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1088/2200] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:15 2022] PUT /identity/v3/projects/a782875bb3a14514820490abf56cbaef/users/7967c4a703de466b8910721bb8746257/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:16.028668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.122379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e539a-b319-4a87-8105-0d327f6b0147 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.127349 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14554db5-7b26-489b-b998-7e386f10d451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.128074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554db5-7b26-489b-b998-7e386f10d451 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.128344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554db5-7b26-489b-b998-7e386f10d451 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.128691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14554db5-7b26-489b-b998-7e386f10d451 admin admin] PATH_INFO: `/v3/projects/cdcf8c4ebf2b45d3ba527fde49c5f247/users/d13b37838e8e45fbae6b9e26dcaf1d92/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.130946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554db5-7b26-489b-b998-7e386f10d451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcf8c4ebf2b45d3ba527fde49c5f247, user_id=d13b37838e8e45fbae6b9e26dcaf1d92, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:16.133666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14554db5-7b26-489b-b998-7e386f10d451 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.144553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1089/2201] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:16 2022] PUT /identity/v3/projects/cdcf8c4ebf2b45d3ba527fde49c5f247/users/d13b37838e8e45fbae6b9e26dcaf1d92/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:16.145772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5225-e413-4046-8467-073d65ea2a91 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.146067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5225-e413-4046-8467-073d65ea2a91 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.146379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f5225-e413-4046-8467-073d65ea2a91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.176385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-010f5225-e413-4046-8467-073d65ea2a91 None None] MFA Rules not processed for user `7967c4a703de466b8910721bb8746257`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:16.177555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-010f5225-e413-4046-8467-073d65ea2a91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:16.247338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1090/2202] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:16.248747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.249042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.249316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.284098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] MFA Rules not processed for user `d13b37838e8e45fbae6b9e26dcaf1d92`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:16.285566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:16.288062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9a224f37eaf4bfa9985f9064b860295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:16.288765 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9a224f37eaf4bfa9985f9064b860295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:16.361017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1091/2203] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:16.361854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.363231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:16.367306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:16.368736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9a224f37eaf4bfa9985f9064b860295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:16.376411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9a224f37eaf4bfa9985f9064b860295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:16.389929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dcc9c3ad-a324-4174-80d2-5fdbbd509eab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9a224f37eaf4bfa9985f9064b860295'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:16.397064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1113/2204] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:15 2022] DELETE /identity/v3/users/f9a224f37eaf4bfa9985f9064b860295 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:16.401846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.402205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.402754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.422568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:16.423923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:16.441025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47780753-ca2a-4f07-bd1e-79930f077e73 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.494140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1114/2205] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:16.500306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.500933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.501217 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.501495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.502136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:16.503024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.504085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.504434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:16.565180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9b9193-73a7-470d-86dc-3cf7a6cc3550 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.575141 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.575757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.576043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.576319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.586586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:16.588067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.597579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1115/2206] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:16.598537 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.600297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:16.661872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ca6041-be6f-418b-9b5d-117840a50af7 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.670900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1092/2207] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:16 2022] POST /identity/v3/projects => generated 371 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:16.671436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.671436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.671436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.671436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.672116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.749026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a33c30-cd57-4e2f-b6b1-e5a71c2eb7be admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.757276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.757938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.758222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.759225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.760597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:16.763189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.768929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:16.779856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:16.781798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.793280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1116/2208] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:16.878722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1093/2209] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:16 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:16.881899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.904260 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a305a4-a1f1-446a-a808-8328e3ea7cda service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.909881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.911126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.911593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.912711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.914782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:16.918572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.923826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.926363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:16.935492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1117/2210] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:16 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:16.939856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:16.943784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df115a-f70b-406a-a6a0-dd4a03937b58 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.948904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.950143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.950517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.950850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] PATH_INFO: `/v3/projects/87687e97495245ccbd1a4758757e4bf0` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:16.952368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=87687e97495245ccbd1a4758757e4bf0)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:16.954375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:16.980119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60af6928-8132-447c-89a2-9c246967e9fc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:16.994400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:16.995230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:16.995666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:16.996124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] PATH_INFO: `/v3/projects/2c038f33ce664adc9b6d8e5aaf72c5b0/users/f834cc160b7644409ecc6a75c0bb27c0/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.024907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:17.027248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c038f33ce664adc9b6d8e5aaf72c5b0, user_id=f834cc160b7644409ecc6a75c0bb27c0, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.030185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.139681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1118/2211] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:16 2022] PUT /identity/v3/projects/2c038f33ce664adc9b6d8e5aaf72c5b0/users/f834cc160b7644409ecc6a75c0bb27c0/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:17.145613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.174285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87687e97495245ccbd1a4758757e4bf0', 'request_id': 'req-7f41b508-7a3f-4933-b193-cafab153cbfe'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:17.179960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:17.183296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87687e97495245ccbd1a4758757e4bf0', 'request_id': 'req-7f41b508-7a3f-4933-b193-cafab153cbfe'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:17.190059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87687e97495245ccbd1a4758757e4bf0', 'request_id': 'req-7f41b508-7a3f-4933-b193-cafab153cbfe'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:17.230435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7df46e-482a-4842-b9a1-59308dc39adc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.285479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] The token cache is being invalidate because project 87687e97495245ccbd1a4758757e4bf0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:17.285964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:17.286443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7f41b508-7a3f-4933-b193-cafab153cbfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:17.289210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1094/2212] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:16 2022] DELETE /identity/v3/projects/87687e97495245ccbd1a4758757e4bf0 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:17.294565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d9ed9-be72-4de3-8d51-1f6111445312 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.294984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d9ed9-be72-4de3-8d51-1f6111445312 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.295174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60d9ed9-be72-4de3-8d51-1f6111445312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.309473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.311362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.311893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.312781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.313979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.316580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.322346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a60d9ed9-be72-4de3-8d51-1f6111445312 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:17.323832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a60d9ed9-be72-4de3-8d51-1f6111445312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:17.333265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1119/2213] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:17.334187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.334602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1095/2214] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:17.341831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:17.349326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ad92-0604-4991-9217-3e2b08bc9aa0 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.350120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ad92-0604-4991-9217-3e2b08bc9aa0 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.350120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7ad92-0604-4991-9217-3e2b08bc9aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.357212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27dff82-afa1-4e8b-9f89-705665bb2822 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.378512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea16bc-c9a4-4c66-b88a-c1c4e7859e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.378512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea16bc-c9a4-4c66-b88a-c1c4e7859e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.378512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea16bc-c9a4-4c66-b88a-c1c4e7859e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.378512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea16bc-c9a4-4c66-b88a-c1c4e7859e49 admin admin] PATH_INFO: `/v3/projects/2c038f33ce664adc9b6d8e5aaf72c5b0/users/f834cc160b7644409ecc6a75c0bb27c0/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.378940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea16bc-c9a4-4c66-b88a-c1c4e7859e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c038f33ce664adc9b6d8e5aaf72c5b0, user_id=f834cc160b7644409ecc6a75c0bb27c0, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.380457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea16bc-c9a4-4c66-b88a-c1c4e7859e49 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.386225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-4db7ad92-0604-4991-9217-3e2b08bc9aa0 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:17.387544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4db7ad92-0604-4991-9217-3e2b08bc9aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:17.397305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1120/2215] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:17 2022] PUT /identity/v3/projects/2c038f33ce664adc9b6d8e5aaf72c5b0/users/f834cc160b7644409ecc6a75c0bb27c0/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:17.408120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.408411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.408701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.444117 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] MFA Rules not processed for user `f834cc160b7644409ecc6a75c0bb27c0`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:17.446315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:17.473689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1096/2216] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:17.479104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ad92-0604-4991-9217-3e2b08bc9aa0 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.488748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7ad92-0604-4991-9217-3e2b08bc9aa0 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.496160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.496774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.497054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.497332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.498000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:17.498286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.499935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.515097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1097/2217] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:17.516110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.525572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cfbce7-1064-4dc5-a4c3-9ac4d861b9cd admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.525964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1121/2218] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:17 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:17.531465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.532114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.532421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.533144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.533351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.535331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.542292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.544107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:17.600235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bd861-018c-4ca4-b127-cd49dd651dd9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.603895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.604499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.604776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.605045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.606885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:17.621962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1098/2219] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:17 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:17.623215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.673626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.675112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.684853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1122/2220] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:17.692351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc61a0b-da69-4f4f-8c14-92b305c94415 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.699781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.700413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.700700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.701010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.701742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.703844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.778807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1099/2221] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:17 2022] POST /identity/v3/users => generated 299 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:17.782815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.794107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6961f2-130d-447a-b210-b97e4fc54b88 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.799056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.799675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.799961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.800232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.800915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.802716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.813895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1123/2222] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:17.817713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.828243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ce8f42-22a6-4ac9-b091-9b8258471981 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.833021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bb9209-a923-48d9-9b00-7073ea472885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.833629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9209-a923-48d9-9b00-7073ea472885 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.833913 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9209-a923-48d9-9b00-7073ea472885 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.834714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bb9209-a923-48d9-9b00-7073ea472885 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.835402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9209-a923-48d9-9b00-7073ea472885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.837008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02bb9209-a923-48d9-9b00-7073ea472885 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.847409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1100/2223] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:17.851573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:17.861571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f705ba6-be52-4bce-9d7b-a61c60a53e20 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:17.866651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:17.867327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:17.867610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:17.867882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] PATH_INFO: `/v3/projects/f8ab09bf7b8d4f27a9ef3480a64c5a27/users/e176d7f057164a6a9bb2003589f84142/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:17.883275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8ab09bf7b8d4f27a9ef3480a64c5a27, user_id=e176d7f057164a6a9bb2003589f84142, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:17.885999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:17.904154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:17.991221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:17.997249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1124/2224] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:17 2022] PUT /identity/v3/projects/f8ab09bf7b8d4f27a9ef3480a64c5a27/users/e176d7f057164a6a9bb2003589f84142/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:18.008683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:18.008970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:18.009318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:18.042419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] MFA Rules not processed for user `e176d7f057164a6a9bb2003589f84142`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:18.043330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.079380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:18.082131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.117841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1101/2225] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:18 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:18.158804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:18.160416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.167049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bac45f-9ddd-4504-bc65-38ece8b3e8bf admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:18.171976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:18.172630 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:18.172909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:18.173184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] PATH_INFO: `/v3/users/71e3c97afe074a7eb129b468c9740130` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:18.174317 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71e3c97afe074a7eb129b468c9740130)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:18.176360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:18.218745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144261dc-be95-40a6-b413-e2667eae33ed None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:18.223519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3165171-77c5-474a-a564-f3602ce95c6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:18.224131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165171-77c5-474a-a564-f3602ce95c6e service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:18.224410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165171-77c5-474a-a564-f3602ce95c6e service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:18.224681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165171-77c5-474a-a564-f3602ce95c6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:18.234187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3165171-77c5-474a-a564-f3602ce95c6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:18.235647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3165171-77c5-474a-a564-f3602ce95c6e service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:18.245487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1102/2226] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:18.404918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71e3c97afe074a7eb129b468c9740130'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:18.406302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71e3c97afe074a7eb129b468c9740130'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:18.470043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71e3c97afe074a7eb129b468c9740130'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:18.487198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71e3c97afe074a7eb129b468c9740130'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:18.502715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71e3c97afe074a7eb129b468c9740130'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:18.514943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1125/2227] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:18 2022] DELETE /identity/v3/users/71e3c97afe074a7eb129b468c9740130 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:18.516669 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:18.516961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:18.517235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:18.554748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:18.556665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.603368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:18.612720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:18.622244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.664324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:18.683923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1103/2228] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:18.690865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:18.692343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.696346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae273ad-9513-4174-a4f0-ba2e6a68973d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:18.700278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:18.700902 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:18.701189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:18.701464 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:18.703629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.751586 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f697ab-001c-4391-aca1-8714f76a37ae None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:18.755383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:18.756042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:18.756350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:18.756619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:18.765058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:18.766011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:18.766440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:18.767507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:18.781118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1126/2229] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:18.782644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1104/2230] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:18.807880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:18.809646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.821580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291c737-eaf1-44eb-a825-c9c5022e974e service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:18.826293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebfa0f-fd68-41ee-9b20-e91bad541a8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:18.826946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebfa0f-fd68-41ee-9b20-e91bad541a8d service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:18.827273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebfa0f-fd68-41ee-9b20-e91bad541a8d service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:18.827498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebfa0f-fd68-41ee-9b20-e91bad541a8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:18.829810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-63ebfa0f-fd68-41ee-9b20-e91bad541a8d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:18.899901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebfa0f-fd68-41ee-9b20-e91bad541a8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:18.900793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebfa0f-fd68-41ee-9b20-e91bad541a8d service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:18.910630 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1127/2231] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:19.219621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:19.221084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:19.234010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87998c2-337e-4b38-8c6e-207f8149a6dc service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:19.239532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:19.240179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:19.240492 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:19.240764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] PATH_INFO: `/v3/projects/41c7142c6380441f9a88283c50ac2b00` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:19.241940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c7142c6380441f9a88283c50ac2b00)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:19.243890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:19.344536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:19.364527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c7142c6380441f9a88283c50ac2b00', 'request_id': 'req-654506dc-eac2-4902-80c7-1ae9a2787171'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:19.371871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c7142c6380441f9a88283c50ac2b00', 'request_id': 'req-654506dc-eac2-4902-80c7-1ae9a2787171'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:19.377502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c7142c6380441f9a88283c50ac2b00', 'request_id': 'req-654506dc-eac2-4902-80c7-1ae9a2787171'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:19.481408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:19.487560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] The token cache is being invalidate because project 41c7142c6380441f9a88283c50ac2b00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:19.498831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:19.498831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-654506dc-eac2-4902-80c7-1ae9a2787171 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:19.498831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1105/2232] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:19 2022] DELETE /identity/v3/projects/41c7142c6380441f9a88283c50ac2b00 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:19.499419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf80a-ae36-4851-a996-71269a9c92f6 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:19.499419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf80a-ae36-4851-a996-71269a9c92f6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:19.499419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cf80a-ae36-4851-a996-71269a9c92f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:19.519594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a23cf80a-ae36-4851-a996-71269a9c92f6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:19.520967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a23cf80a-ae36-4851-a996-71269a9c92f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:19.588057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1128/2233] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:19.596092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731b60e-19d4-4913-bc1f-ef578616c071 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:19.596381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731b60e-19d4-4913-bc1f-ef578616c071 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:19.596669 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3731b60e-19d4-4913-bc1f-ef578616c071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:19.619094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3731b60e-19d4-4913-bc1f-ef578616c071 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:19.620464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3731b60e-19d4-4913-bc1f-ef578616c071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:19.629932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1106/2234] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:19.639203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cf80a-ae36-4851-a996-71269a9c92f6 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:19.654157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23cf80a-ae36-4851-a996-71269a9c92f6 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:19.662737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:19.663629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:19.664013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:19.664397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:19.665328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:19.665739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:19.668378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:19.699320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731b60e-19d4-4913-bc1f-ef578616c071 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:19.703793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1129/2235] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:19.709376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3731b60e-19d4-4913-bc1f-ef578616c071 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:19.715048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:19.715931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:19.716660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:19.716660 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:19.717106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:19.719253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:19.871626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1107/2236] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:19 2022] POST /identity/v3/projects => generated 373 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:19.875972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:19.886425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f445db-c86c-46ea-b56a-b0c21bf7a5ef admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:19.898207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:19.950327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:19.950986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:19.951365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:19.951631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:19.952284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:19.954350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:20.052617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1130/2237] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:19 2022] POST /identity/v3/users => generated 287 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:20.057693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:20.068373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52859e24-1dfc-452f-878c-cdb05cbe8e8b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:20.073312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:20.073871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:20.074332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:20.078064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:20.078064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:20.078064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:20.088892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1108/2238] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:20.092991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:20.106431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd749a5-51ac-467e-95a9-597bed76f00f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:20.111667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dbc240-5640-42e6-8ac0-3faece30f2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:20.112285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbc240-5640-42e6-8ac0-3faece30f2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:20.112569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbc240-5640-42e6-8ac0-3faece30f2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:20.112845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dbc240-5640-42e6-8ac0-3faece30f2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:20.113607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbc240-5640-42e6-8ac0-3faece30f2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:20.115265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dbc240-5640-42e6-8ac0-3faece30f2e7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:20.129759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1131/2239] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:20.131524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:20.142473 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc7dcb6-7dc2-410f-a248-bda0303b145e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:20.148134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:20.152783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:20.152783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:20.152783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] PATH_INFO: `/v3/projects/ac25ab2d22dc47d18c2a08c4bb98cf66/users/08b0e689460243ae8cb644b7477aa978/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:20.165933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac25ab2d22dc47d18c2a08c4bb98cf66, user_id=08b0e689460243ae8cb644b7477aa978, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:20.168716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:20.252831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1109/2240] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:20 2022] PUT /identity/v3/projects/ac25ab2d22dc47d18c2a08c4bb98cf66/users/08b0e689460243ae8cb644b7477aa978/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:20.264491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffd30-e1d6-42e4-baef-6a93b20124a3 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:20.264770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffd30-e1d6-42e4-baef-6a93b20124a3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:20.265053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771ffd30-e1d6-42e4-baef-6a93b20124a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:20.300198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-771ffd30-e1d6-42e4-baef-6a93b20124a3 None None] MFA Rules not processed for user `08b0e689460243ae8cb644b7477aa978`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:20.301444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-771ffd30-e1d6-42e4-baef-6a93b20124a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:20.369596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1132/2241] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:20.514963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:20.517657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:20.581842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ce1d31-18c3-45e4-8da5-b9522231b2bc admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:20.586189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c82e70-25a8-4fdb-a15a-94d2f6a4dd4e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:20.586843 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c82e70-25a8-4fdb-a15a-94d2f6a4dd4e service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:20.587125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c82e70-25a8-4fdb-a15a-94d2f6a4dd4e service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:20.587397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c82e70-25a8-4fdb-a15a-94d2f6a4dd4e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:20.596744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c82e70-25a8-4fdb-a15a-94d2f6a4dd4e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:20.598205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c82e70-25a8-4fdb-a15a-94d2f6a4dd4e service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:20.608036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1110/2242] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:20.635130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ffd30-e1d6-42e4-baef-6a93b20124a3 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:20.708564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771ffd30-e1d6-42e4-baef-6a93b20124a3 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:20.716202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:20.716866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:20.717155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:20.717553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] PATH_INFO: `/v3/users/08b0e689460243ae8cb644b7477aa978` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:20.718803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=08b0e689460243ae8cb644b7477aa978)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:20.721372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:20.725138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:20.942841 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08b0e689460243ae8cb644b7477aa978'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:20.943825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08b0e689460243ae8cb644b7477aa978'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:21.007515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08b0e689460243ae8cb644b7477aa978'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:21.020255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08b0e689460243ae8cb644b7477aa978'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:21.043565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08b0e689460243ae8cb644b7477aa978'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:21.054503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1133/2243] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:20 2022] DELETE /identity/v3/users/08b0e689460243ae8cb644b7477aa978 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:21.061390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:21.061952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:21.062279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:21.090703 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:21.091990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:21.188071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1111/2244] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:21.202650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:21.206163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:21.207226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:21.209336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:21.289264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e618e2aa-269a-489f-87ee-45bcdc54d437 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:21.293237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:21.293867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:21.294153 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:21.294427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:21.296263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:21.312539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9013f0-d4d2-4d5b-9655-830c7d7ab3fd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:21.319380 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:21.320553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:21.321059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:21.321599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:21.337244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:21.339200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:21.350885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1134/2245] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:21.377731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:21.380582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:21.393823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1112/2246] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:21 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:21.618994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:21.700099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:21.845328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:21.847035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:21.864235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb4846-20b1-4a39-9e95-0ce6432ce771 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:21.872800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:21.873469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:21.873763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:21.874112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] PATH_INFO: `/v3/projects/ac25ab2d22dc47d18c2a08c4bb98cf66` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:21.876440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac25ab2d22dc47d18c2a08c4bb98cf66)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:21.878613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:22.060632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac25ab2d22dc47d18c2a08c4bb98cf66', 'request_id': 'req-7ebd1cb2-6933-4c9e-abc1-8670457fcace'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.066405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac25ab2d22dc47d18c2a08c4bb98cf66', 'request_id': 'req-7ebd1cb2-6933-4c9e-abc1-8670457fcace'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.186036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac25ab2d22dc47d18c2a08c4bb98cf66', 'request_id': 'req-7ebd1cb2-6933-4c9e-abc1-8670457fcace'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.197281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:22.199059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:22.201343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] The token cache is being invalidate because project ac25ab2d22dc47d18c2a08c4bb98cf66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:22.202246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.202846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7ebd1cb2-6933-4c9e-abc1-8670457fcace admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.204610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1135/2247] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:21 2022] DELETE /identity/v3/projects/ac25ab2d22dc47d18c2a08c4bb98cf66 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:22.221271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe862550-853a-4eee-8203-b03157f7b3d0 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:22.299306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:22.299846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:22.300159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:22.301060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] PATH_INFO: `/v3/users/7967c4a703de466b8910721bb8746257` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:22.302502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7967c4a703de466b8910721bb8746257)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:22.305230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:22.545581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7967c4a703de466b8910721bb8746257'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.546256 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7967c4a703de466b8910721bb8746257'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.625399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7967c4a703de466b8910721bb8746257'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.641666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7967c4a703de466b8910721bb8746257'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.649344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7967c4a703de466b8910721bb8746257'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:22.655696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1113/2248] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:22 2022] DELETE /identity/v3/users/7967c4a703de466b8910721bb8746257 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:22.660180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:22.660463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:22.660740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:22.681045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:22.682342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:22.755876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1136/2249] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:22.766096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:22.767556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:22.845235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7e145-c440-492c-8543-a6d292a43360 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:22.849130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:22.849730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:22.850013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:22.850290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:22.860727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:22.862262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:22.875131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1114/2250] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:23.218780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:23.299275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:23.312319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:23.313799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:23.326253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd319083-277e-49b3-ade3-83e17d40b61f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:23.342086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:23.342833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:23.343284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:23.343741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] PATH_INFO: `/v3/projects/a782875bb3a14514820490abf56cbaef` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:23.345203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a782875bb3a14514820490abf56cbaef)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:23.347460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:23.503811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a782875bb3a14514820490abf56cbaef', 'request_id': 'req-c2079f6f-5bee-401f-8971-40b961620500'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:23.509976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a782875bb3a14514820490abf56cbaef', 'request_id': 'req-c2079f6f-5bee-401f-8971-40b961620500'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:23.572723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a782875bb3a14514820490abf56cbaef', 'request_id': 'req-c2079f6f-5bee-401f-8971-40b961620500'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:23.585835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] The token cache is being invalidate because project a782875bb3a14514820490abf56cbaef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:23.586194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:23.586828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:23.588335 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1137/2251] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:23 2022] DELETE /identity/v3/projects/a782875bb3a14514820490abf56cbaef => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:23.592308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:23.602345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6895185f-a362-4df0-a47d-59ae4d362f97 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:23.663225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:23.663853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:23.664273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:23.664561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] PATH_INFO: `/v3/users/f834cc160b7644409ecc6a75c0bb27c0` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:23.665756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f834cc160b7644409ecc6a75c0bb27c0)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:23.671149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:23.918451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f834cc160b7644409ecc6a75c0bb27c0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:23.919201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f834cc160b7644409ecc6a75c0bb27c0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:23.989518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f834cc160b7644409ecc6a75c0bb27c0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.007370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f834cc160b7644409ecc6a75c0bb27c0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.016999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f834cc160b7644409ecc6a75c0bb27c0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.023674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1115/2252] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:23 2022] DELETE /identity/v3/users/f834cc160b7644409ecc6a75c0bb27c0 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:24.170883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:24.172269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:24.232649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2079f6f-5bee-401f-8971-40b961620500 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:24.287377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11aa6648-80dd-471c-9be3-d3e8b69229d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:24.287377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa6648-80dd-471c-9be3-d3e8b69229d3 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:24.287377 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa6648-80dd-471c-9be3-d3e8b69229d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:24.287965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11aa6648-80dd-471c-9be3-d3e8b69229d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:24.290386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-11aa6648-80dd-471c-9be3-d3e8b69229d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:24.356235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa6648-80dd-471c-9be3-d3e8b69229d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:24.357745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11aa6648-80dd-471c-9be3-d3e8b69229d3 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:24.368508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1138/2253] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:24.435833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:24.455009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:24.456481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:24.551304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3488ed48-78c1-4b0b-a24b-0b23ddba065a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:24.556620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:24.557271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:24.557556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:24.557892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] PATH_INFO: `/v3/projects/2c038f33ce664adc9b6d8e5aaf72c5b0` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:24.559145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c038f33ce664adc9b6d8e5aaf72c5b0)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:24.561082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:24.745443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c038f33ce664adc9b6d8e5aaf72c5b0', 'request_id': 'req-52dc48c0-e00e-4160-b58a-fda719bb0cf5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.752315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c038f33ce664adc9b6d8e5aaf72c5b0', 'request_id': 'req-52dc48c0-e00e-4160-b58a-fda719bb0cf5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.759041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c038f33ce664adc9b6d8e5aaf72c5b0', 'request_id': 'req-52dc48c0-e00e-4160-b58a-fda719bb0cf5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.898369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] The token cache is being invalidate because project 2c038f33ce664adc9b6d8e5aaf72c5b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:24.898696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.901343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-52dc48c0-e00e-4160-b58a-fda719bb0cf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:24.901343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1116/2254] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:24 2022] DELETE /identity/v3/projects/2c038f33ce664adc9b6d8e5aaf72c5b0 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:24.906110 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b08b-09c8-49dd-8e5f-a3d58c277111 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:24.906400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b08b-09c8-49dd-8e5f-a3d58c277111 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:24.906672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67b08b-09c8-49dd-8e5f-a3d58c277111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:24.927681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4d67b08b-09c8-49dd-8e5f-a3d58c277111 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:24.928904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4d67b08b-09c8-49dd-8e5f-a3d58c277111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:24.993645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1139/2255] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:24.999123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9552c-ca2e-44f8-a70d-6ed2b870c36f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:24.999687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9552c-ca2e-44f8-a70d-6ed2b870c36f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.000340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f9552c-ca2e-44f8-a70d-6ed2b870c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.024538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d1f9552c-ca2e-44f8-a70d-6ed2b870c36f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:25.025605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d1f9552c-ca2e-44f8-a70d-6ed2b870c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:25.034207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1117/2256] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:25.038694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67b08b-09c8-49dd-8e5f-a3d58c277111 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:25.049005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67b08b-09c8-49dd-8e5f-a3d58c277111 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:25.053934 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:25.054545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.055512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.055806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.056458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:25.057489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:25.058389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:25.081811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1140/2257] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:25.089700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9552c-ca2e-44f8-a70d-6ed2b870c36f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:25.099277 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f9552c-ca2e-44f8-a70d-6ed2b870c36f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:25.104620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:25.105289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.105581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.105861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.106504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:25.108571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:25.262897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1118/2258] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:25 2022] POST /identity/v3/projects => generated 369 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:25.264621 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:25.274834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416e46ba-ccab-4b77-8a84-6d9f8135e419 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:25.283855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:25.332312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:25.333014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.333296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.333568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.334192 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:25.336778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:25.489322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1141/2259] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:25 2022] POST /identity/v3/users => generated 285 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:25.493742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:25.505138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9292c0e7-8a4d-4729-9432-a6200f0120a3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:25.510512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:25.512044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.512587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.518839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.518839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:25.518839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:25.537201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1119/2260] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:25.541927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:25.552609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580505c-cae8-4607-a9b0-7ba8279df34a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:25.558220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04796ef2-b814-46b8-aaa2-4e4acdbbb922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:25.559139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04796ef2-b814-46b8-aaa2-4e4acdbbb922 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.559422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04796ef2-b814-46b8-aaa2-4e4acdbbb922 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.559701 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04796ef2-b814-46b8-aaa2-4e4acdbbb922 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.560349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04796ef2-b814-46b8-aaa2-4e4acdbbb922 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:25.561959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04796ef2-b814-46b8-aaa2-4e4acdbbb922 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:25.574116 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1142/2261] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:25.578498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:25.589611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f92ba6-07ea-4866-b0a7-a3d2da909182 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:25.594847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:25.595541 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.595832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.596113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] PATH_INFO: `/v3/projects/76e36a832438477eb8aabe7e2d736335/users/4c5a6b69f7434e048f1eae02b83037b2/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.613020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e36a832438477eb8aabe7e2d736335, user_id=4c5a6b69f7434e048f1eae02b83037b2, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:25.615763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:25.728044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1120/2262] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:25 2022] PUT /identity/v3/projects/76e36a832438477eb8aabe7e2d736335/users/4c5a6b69f7434e048f1eae02b83037b2/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:25.738490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.738787 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.739099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.783694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] MFA Rules not processed for user `4c5a6b69f7434e048f1eae02b83037b2`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:25.784610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:25.856143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1143/2263] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:25.867985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:25.870330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:25.964702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28af4684-7262-4185-a3b4-c634a64f9761 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:25.968756 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:25.969371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:25.969658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:25.970076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:25.980394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:25.981862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:26.002445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1121/2264] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:26.399166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:26.400749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:26.466940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dc0f06-4c7e-4fee-b45d-4f3faced045f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:26.471668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:26.472304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:26.472606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:26.472874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] PATH_INFO: `/v3/users/197fd6403f79469bb77de153f4fd9ede` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:26.474000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] RBAC: Authorizing `identity:delete_user(user_id=197fd6403f79469bb77de153f4fd9ede)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:26.476147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:26.603400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:26.631840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:26.633617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:26.648048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e5e917-1ff3-48a9-b5b1-2ca2395ca98a service glance] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:26.652679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:26.655475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:26.655475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:26.655475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] PATH_INFO: `/v3/users/e176d7f057164a6a9bb2003589f84142` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:26.655475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e176d7f057164a6a9bb2003589f84142)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:26.657339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:26.776830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '197fd6403f79469bb77de153f4fd9ede'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:26.777617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '197fd6403f79469bb77de153f4fd9ede'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:26.906504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '197fd6403f79469bb77de153f4fd9ede'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:26.917864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '197fd6403f79469bb77de153f4fd9ede'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:26.933495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8b3d4ab6-dd08-498d-a693-b8dd2ddff755 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '197fd6403f79469bb77de153f4fd9ede'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:26.941714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1144/2265] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:26 2022] DELETE /identity/v3/users/197fd6403f79469bb77de153f4fd9ede => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:26.946666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:26.947062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:26.947340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:26.948698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e176d7f057164a6a9bb2003589f84142'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:26.949543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e176d7f057164a6a9bb2003589f84142'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:26.970389 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:26.971912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:27.043290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1145/2266] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:27.050181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:27.056217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:27.079912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e176d7f057164a6a9bb2003589f84142'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:27.094050 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e176d7f057164a6a9bb2003589f84142'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:27.101838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ceecbb0-c7f4-4a67-a6e7-193a7dbf6900 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e176d7f057164a6a9bb2003589f84142'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:27.109303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1122/2267] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:26 2022] DELETE /identity/v3/users/e176d7f057164a6a9bb2003589f84142 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:27.115499 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:27.125451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:27.125451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:27.127555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ecbea6-e631-4b0e-b32e-c88df75a09c9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:27.136327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:27.137624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:27.183228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:27.183847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:27.184131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:27.184403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:27.186209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:27.203296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1123/2268] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:27.213891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:27.215422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:27.229528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53868dce-5846-4ee3-9d32-af42b0a027cf None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:27.234326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:27.234984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:27.235506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:27.235823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:27.245423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:27.246892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:27.255014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:27.256720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1124/2269] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:27.257933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:27.268806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1146/2270] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:27.341137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:27.890869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:27.893885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:27.924503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaa2c1-e1cd-488f-82a5-73cb15ea49c6 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:27.934121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:27.934534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:27.934923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:27.942584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] PATH_INFO: `/v3/projects/f8ab09bf7b8d4f27a9ef3480a64c5a27` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:27.942584 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8ab09bf7b8d4f27a9ef3480a64c5a27)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:27.943196 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:27.943705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:27.943807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:27.957681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42969e27-b455-4590-9cd3-683034c1fac0 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:27.963410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:27.964722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:27.966047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:27.966495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] PATH_INFO: `/v3/projects/97e6b803ada9499297d007070eab67c4` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:27.971125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e6b803ada9499297d007070eab67c4)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:27.971125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:28.159023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e6b803ada9499297d007070eab67c4', 'request_id': 'req-01014419-1cec-43b6-afed-c2c26cb93d03'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.160877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8ab09bf7b8d4f27a9ef3480a64c5a27', 'request_id': 'req-fd15bf90-b872-4fcf-bc5e-aaff02134eda'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.164980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e6b803ada9499297d007070eab67c4', 'request_id': 'req-01014419-1cec-43b6-afed-c2c26cb93d03'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.167536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8ab09bf7b8d4f27a9ef3480a64c5a27', 'request_id': 'req-fd15bf90-b872-4fcf-bc5e-aaff02134eda'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.173356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8ab09bf7b8d4f27a9ef3480a64c5a27', 'request_id': 'req-fd15bf90-b872-4fcf-bc5e-aaff02134eda'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.305859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e6b803ada9499297d007070eab67c4', 'request_id': 'req-01014419-1cec-43b6-afed-c2c26cb93d03'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.317770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] The token cache is being invalidate because project 97e6b803ada9499297d007070eab67c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:28.318064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.318755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.320281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1147/2271] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:27 2022] DELETE /identity/v3/projects/97e6b803ada9499297d007070eab67c4 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:28.324770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:28.326269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:28.367209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] The token cache is being invalidate because project f8ab09bf7b8d4f27a9ef3480a64c5a27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:28.367601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.368863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.370466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1125/2272] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:27 2022] DELETE /identity/v3/projects/f8ab09bf7b8d4f27a9ef3480a64c5a27 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:28.393972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01014419-1cec-43b6-afed-c2c26cb93d03 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:28.459391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:28.460314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:28.460747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:28.461221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] PATH_INFO: `/v3/users/949b1ffc71c54a55a8dca7a6a1fbb594` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:28.462685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] RBAC: Authorizing `identity:delete_user(user_id=949b1ffc71c54a55a8dca7a6a1fbb594)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:28.464718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:28.671006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:28.707751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '949b1ffc71c54a55a8dca7a6a1fbb594'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.713090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '949b1ffc71c54a55a8dca7a6a1fbb594'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.797718 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '949b1ffc71c54a55a8dca7a6a1fbb594'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.806435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '949b1ffc71c54a55a8dca7a6a1fbb594'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.818682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '949b1ffc71c54a55a8dca7a6a1fbb594'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:28.825041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1148/2273] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:28 2022] DELETE /identity/v3/users/949b1ffc71c54a55a8dca7a6a1fbb594 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:29.370008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:29.376815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:29.389381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd15bf90-b872-4fcf-bc5e-aaff02134eda admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:29.452455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603644-f120-4831-a452-892199578131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:29.453105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603644-f120-4831-a452-892199578131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:29.453388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603644-f120-4831-a452-892199578131 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:29.453667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77603644-f120-4831-a452-892199578131 admin admin] PATH_INFO: `/v3/projects/75def8f9bf144245b120be8a2bf9d7cf` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:29.454842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603644-f120-4831-a452-892199578131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75def8f9bf144245b120be8a2bf9d7cf)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:29.456762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77603644-f120-4831-a452-892199578131 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:29.584536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:29.586071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:29.600412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d55ac-6446-4e89-8789-b494e679028f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:29.604121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:29.615232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-77603644-f120-4831-a452-892199578131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75def8f9bf144245b120be8a2bf9d7cf', 'request_id': 'req-77603644-f120-4831-a452-892199578131'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.618677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-77603644-f120-4831-a452-892199578131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75def8f9bf144245b120be8a2bf9d7cf', 'request_id': 'req-77603644-f120-4831-a452-892199578131'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.624648 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-77603644-f120-4831-a452-892199578131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75def8f9bf144245b120be8a2bf9d7cf', 'request_id': 'req-77603644-f120-4831-a452-892199578131'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.663494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:29.664152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:29.664461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:29.664741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] PATH_INFO: `/v3/users/54766892eda44f5395a5cd6aa2035634` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:29.665940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54766892eda44f5395a5cd6aa2035634)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:29.668014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:29.704459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-77603644-f120-4831-a452-892199578131 admin admin] The token cache is being invalidate because project 75def8f9bf144245b120be8a2bf9d7cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:29.704749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-77603644-f120-4831-a452-892199578131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.705383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-77603644-f120-4831-a452-892199578131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.706917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1126/2274] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:29 2022] DELETE /identity/v3/projects/75def8f9bf144245b120be8a2bf9d7cf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:29.710901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603644-f120-4831-a452-892199578131 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:29.713178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-77603644-f120-4831-a452-892199578131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:29.725530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77603644-f120-4831-a452-892199578131 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:29.731236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:29.732245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:29.732746 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:29.733244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] PATH_INFO: `/v3/users/592b2125c6644975a399a5169de55955` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:29.735135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=592b2125c6644975a399a5169de55955)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:29.738753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:29.914716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54766892eda44f5395a5cd6aa2035634'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.915439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54766892eda44f5395a5cd6aa2035634'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.985520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54766892eda44f5395a5cd6aa2035634'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:29.993891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54766892eda44f5395a5cd6aa2035634'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:30.000311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '592b2125c6644975a399a5169de55955'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:30.001075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '592b2125c6644975a399a5169de55955'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:30.006000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3a00102d-7cfa-45e6-849c-0206c371dc24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54766892eda44f5395a5cd6aa2035634'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:30.012852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1149/2275] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:29 2022] DELETE /identity/v3/users/54766892eda44f5395a5cd6aa2035634 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:30.017249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:30.017561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:30.024656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:30.036563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:30.037790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:30.106868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1150/2276] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:30.118466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:30.120017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:30.192334 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f754260-f2b2-402f-99c2-8da4c17b7024 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:30.197977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:30.198649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:30.199041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:30.199321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:30.209626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:30.211452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:30.222894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1151/2277] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:30.460060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '592b2125c6644975a399a5169de55955'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:30.463449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:30.475064 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '592b2125c6644975a399a5169de55955'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:30.483083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '592b2125c6644975a399a5169de55955'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:30.489124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1127/2278] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:29 2022] DELETE /identity/v3/users/592b2125c6644975a399a5169de55955 => generated 0 bytes in 779 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:31.206588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:31.208323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:31.208463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:31.209754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:31.240744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6703652a-0997-4ad1-ba35-24874bedd35e service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:31.320843 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:31.322401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:31.322936 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:31.323423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] PATH_INFO: `/v3/projects/4df34531b02744e69193e145034777f9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:31.325385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4df34531b02744e69193e145034777f9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:31.328596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:31.352854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87587fda-e214-4877-8543-8b39063644ff admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:31.358275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:31.359013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:31.370308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:31.370308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] PATH_INFO: `/v3/projects/9f84e43e801b4cdfa05f095844cf013a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:31.370308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f84e43e801b4cdfa05f095844cf013a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:31.370308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:31.500705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4df34531b02744e69193e145034777f9', 'request_id': 'req-ebf82600-233f-4caa-9684-4f23d2343f17'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.503325 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f84e43e801b4cdfa05f095844cf013a', 'request_id': 'req-d9418923-b885-453f-afe4-0009feefd9da'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.506308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4df34531b02744e69193e145034777f9', 'request_id': 'req-ebf82600-233f-4caa-9684-4f23d2343f17'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.510295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f84e43e801b4cdfa05f095844cf013a', 'request_id': 'req-d9418923-b885-453f-afe4-0009feefd9da'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.516117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f84e43e801b4cdfa05f095844cf013a', 'request_id': 'req-d9418923-b885-453f-afe4-0009feefd9da'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.601822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4df34531b02744e69193e145034777f9', 'request_id': 'req-ebf82600-233f-4caa-9684-4f23d2343f17'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.614049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] The token cache is being invalidate because project 4df34531b02744e69193e145034777f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:31.614340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.615007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ebf82600-233f-4caa-9684-4f23d2343f17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.616532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1152/2279] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:31 2022] DELETE /identity/v3/projects/4df34531b02744e69193e145034777f9 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:31.621768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2b28-a1c7-4b4e-8c3e-918239fbcb4c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:31.622052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2b28-a1c7-4b4e-8c3e-918239fbcb4c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:31.622327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dd2b28-a1c7-4b4e-8c3e-918239fbcb4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:31.642203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-e5dd2b28-a1c7-4b4e-8c3e-918239fbcb4c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:31.643479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e5dd2b28-a1c7-4b4e-8c3e-918239fbcb4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:31.710899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1153/2280] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:31.726564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b494a-2836-45f4-9f0a-38a8a9d1cadb None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:31.727054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b494a-2836-45f4-9f0a-38a8a9d1cadb None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:31.727254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3b494a-2836-45f4-9f0a-38a8a9d1cadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:31.730809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] The token cache is being invalidate because project 9f84e43e801b4cdfa05f095844cf013a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:31.731125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.732632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.734314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1128/2281] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:31 2022] DELETE /identity/v3/projects/9f84e43e801b4cdfa05f095844cf013a => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:31.738653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:31.739988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:31.754158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5c3b494a-2836-45f4-9f0a-38a8a9d1cadb None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:31.754158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5c3b494a-2836-45f4-9f0a-38a8a9d1cadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:31.755161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9418923-b885-453f-afe4-0009feefd9da admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:31.760347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:31.761348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1154/2282] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:31.761607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:31.761899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:31.762348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] PATH_INFO: `/v3/users/98279bfc1f5d40b091f465af1b88e99e` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:31.763594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98279bfc1f5d40b091f465af1b88e99e)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:31.765621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:31.767905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b494a-2836-45f4-9f0a-38a8a9d1cadb None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:31.777935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3b494a-2836-45f4-9f0a-38a8a9d1cadb None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:31.785164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:31.785781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:31.786064 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:31.786343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:31.787034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:31.787342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:31.788958 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:31.804996 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1155/2283] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:59:31.804996 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:31.811870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:31.816346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1222b076-16ef-4ed9-96e3-e6019c1ed671 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:31.821173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:31.821800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:31.822085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:31.822364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:31.823022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:31.824963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:31.862422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:31.956399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1156/2284] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:31 2022] POST /identity/v3/projects => generated 365 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:31.960483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:31.964313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98279bfc1f5d40b091f465af1b88e99e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:31.965000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98279bfc1f5d40b091f465af1b88e99e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:32.030280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c90888a-e69c-4cb5-ae59-6c34f2139814 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:32.038890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:32.039752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:32.040037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:32.040376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:32.041536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:32.043602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:32.077060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98279bfc1f5d40b091f465af1b88e99e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:32.090632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98279bfc1f5d40b091f465af1b88e99e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:32.097680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98279bfc1f5d40b091f465af1b88e99e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:32.104136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1129/2285] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:31 2022] DELETE /identity/v3/users/98279bfc1f5d40b091f465af1b88e99e => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:32.190095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1157/2286] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:31 2022] POST /identity/v3/users => generated 283 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:32.192611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:32.194080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:32.273475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798780c-f0f6-4908-a949-2c2b3170db3d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:32.278969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:32.279588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:32.280144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:32.280426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:32.281135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:32.282790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:32.293922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1130/2287] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:32.298188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:32.309681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be378169-8e41-4ddf-bfd4-5fba9d5a30d0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:32.315183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e242d-2fb6-4c4f-b1da-ae6a0a9c3e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:32.316035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e242d-2fb6-4c4f-b1da-ae6a0a9c3e7a admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:32.316316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e242d-2fb6-4c4f-b1da-ae6a0a9c3e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:32.316640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e242d-2fb6-4c4f-b1da-ae6a0a9c3e7a admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:32.317461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e242d-2fb6-4c4f-b1da-ae6a0a9c3e7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:32.319501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e242d-2fb6-4c4f-b1da-ae6a0a9c3e7a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:32.330876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1158/2288] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:32.335812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:32.347839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1554732-48b5-4d12-a5e6-a9d26489d0f1 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:32.352657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:32.353946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:32.354328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:32.354515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] PATH_INFO: `/v3/projects/6a8c36b6f96f42a0bcfcbf41866779ce/users/7466b4685b3749af8796f601bbfd4016/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:32.372530 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a8c36b6f96f42a0bcfcbf41866779ce, user_id=7466b4685b3749af8796f601bbfd4016, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:32.375673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:32.508326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1131/2289] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:32 2022] PUT /identity/v3/projects/6a8c36b6f96f42a0bcfcbf41866779ce/users/7466b4685b3749af8796f601bbfd4016/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:32.520151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:32.520434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:32.520721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:32.549660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] MFA Rules not processed for user `7466b4685b3749af8796f601bbfd4016`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:32.550925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:32.613417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1159/2290] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:32.624935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:32.626671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:32.665860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:32.669177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:32.704653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80d026f-f7eb-48ac-a2d8-f3ad8e5c08ff admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:32.709480 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:32.710495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:32.719972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:32.719972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:32.734801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:32.736498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:32.751244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1132/2291] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:32.778536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99be9959-7edc-461e-a7af-e8fe7692f502 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:32.786179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:32.786922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:32.787213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:32.787531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] PATH_INFO: `/v3/projects/93740c3264d247a6a95ed15d1f0e340c` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:32.788772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93740c3264d247a6a95ed15d1f0e340c)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:32.790675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:32.927143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93740c3264d247a6a95ed15d1f0e340c', 'request_id': 'req-cb027e21-5bf3-4023-999b-474414ba020d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:32.937868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93740c3264d247a6a95ed15d1f0e340c', 'request_id': 'req-cb027e21-5bf3-4023-999b-474414ba020d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.038899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93740c3264d247a6a95ed15d1f0e340c', 'request_id': 'req-cb027e21-5bf3-4023-999b-474414ba020d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.052412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] The token cache is being invalidate because project 93740c3264d247a6a95ed15d1f0e340c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:33.052860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.053597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.055524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1160/2292] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:32 2022] DELETE /identity/v3/projects/93740c3264d247a6a95ed15d1f0e340c => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:33.059406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:33.072406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec54d4-9c26-4c54-9f3a-b157fc937b3e service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:33.133414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:33.144549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:33.144549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:33.144549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] PATH_INFO: `/v3/users/d13b37838e8e45fbae6b9e26dcaf1d92` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:33.144549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] RBAC: Authorizing `identity:delete_user(user_id=d13b37838e8e45fbae6b9e26dcaf1d92)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:33.144549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:33.353195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:33.420449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd13b37838e8e45fbae6b9e26dcaf1d92'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.421242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd13b37838e8e45fbae6b9e26dcaf1d92'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.437453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:33.521799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd13b37838e8e45fbae6b9e26dcaf1d92'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.562689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd13b37838e8e45fbae6b9e26dcaf1d92'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.569067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd13b37838e8e45fbae6b9e26dcaf1d92'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:33.592575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1133/2293] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:33 2022] DELETE /identity/v3/users/d13b37838e8e45fbae6b9e26dcaf1d92 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:33.710013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:33.717698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:33.724973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb027e21-5bf3-4023-999b-474414ba020d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:33.783623 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:33.784004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:33.784288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:33.784559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] PATH_INFO: `/v3/users/971862487232469cb7804b86814277c7` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:33.785735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=971862487232469cb7804b86814277c7)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:33.787762 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.059376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '971862487232469cb7804b86814277c7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.060327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '971862487232469cb7804b86814277c7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.079618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.083667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:34.097106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df7be08-6beb-4ce5-9a7a-db730565614c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.102671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.108498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.108498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.108498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] PATH_INFO: `/v3/projects/cdcf8c4ebf2b45d3ba527fde49c5f247` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.108498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcf8c4ebf2b45d3ba527fde49c5f247)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.108498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.128497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '971862487232469cb7804b86814277c7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.137478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '971862487232469cb7804b86814277c7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.149568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-090c6204-5574-4654-83d3-feedc83dda22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '971862487232469cb7804b86814277c7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.155941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1161/2294] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:33 2022] DELETE /identity/v3/users/971862487232469cb7804b86814277c7 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:34.160269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.160596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.164181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.181180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:34.183461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:34.247103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcf8c4ebf2b45d3ba527fde49c5f247', 'request_id': 'req-f49a3c85-e468-4d85-96ea-a711558724d4'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.254442 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcf8c4ebf2b45d3ba527fde49c5f247', 'request_id': 'req-f49a3c85-e468-4d85-96ea-a711558724d4'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.256280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1162/2295] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:34.260890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcf8c4ebf2b45d3ba527fde49c5f247', 'request_id': 'req-f49a3c85-e468-4d85-96ea-a711558724d4'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.266264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.267769 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:34.333500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8efaab2-85bb-4d1c-be2a-b6bdc3842ee8 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.354807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:34.395104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] The token cache is being invalidate because project cdcf8c4ebf2b45d3ba527fde49c5f247 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:34.395104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.395104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f49a3c85-e468-4d85-96ea-a711558724d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:34.400932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156cf148-98ca-4418-a82e-c492b1c8567a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.402017 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf148-98ca-4418-a82e-c492b1c8567a service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.402415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf148-98ca-4418-a82e-c492b1c8567a service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.402808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156cf148-98ca-4418-a82e-c492b1c8567a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.404800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-156cf148-98ca-4418-a82e-c492b1c8567a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:34.407230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1134/2296] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:34 2022] DELETE /identity/v3/projects/cdcf8c4ebf2b45d3ba527fde49c5f247 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:34.413386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5c49-d3bb-4708-bb44-e7bc25485649 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.413687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5c49-d3bb-4708-bb44-e7bc25485649 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.413968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5c49-d3bb-4708-bb44-e7bc25485649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.435107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ceef5c49-d3bb-4708-bb44-e7bc25485649 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:34.436326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ceef5c49-d3bb-4708-bb44-e7bc25485649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:34.474425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf148-98ca-4418-a82e-c492b1c8567a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.476008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156cf148-98ca-4418-a82e-c492b1c8567a service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.486853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1163/2297] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:34.495570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1135/2298] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:34.505682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317e2ca-51eb-4c4b-a516-b45f8d175f69 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.505978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317e2ca-51eb-4c4b-a516-b45f8d175f69 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.506250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d317e2ca-51eb-4c4b-a516-b45f8d175f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.534896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d317e2ca-51eb-4c4b-a516-b45f8d175f69 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:34.536149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d317e2ca-51eb-4c4b-a516-b45f8d175f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:34.545280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1164/2299] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:34.549666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef5c49-d3bb-4708-bb44-e7bc25485649 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.559473 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef5c49-d3bb-4708-bb44-e7bc25485649 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.564238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.564857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.565147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.565410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.566057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:34.566388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.568025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.579761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1136/2300] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:34.590555 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317e2ca-51eb-4c4b-a516-b45f8d175f69 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.600974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d317e2ca-51eb-4c4b-a516-b45f8d175f69 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.606503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.607151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.609995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.609995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.609995 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.610412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.623040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:34.721000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:34.721534 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1165/2301] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:34 2022] POST /identity/v3/projects => generated 401 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:34.725736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.736784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d630a43-540f-481f-a815-068e137eacf6 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.814976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:34.818358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.819175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.819355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.819625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.820300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.822745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.907486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1137/2302] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:34 2022] POST /identity/v3/users => generated 301 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:34.911709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.922202 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb024f-3a47-44c5-b5ca-a9d2de3c0f25 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.930911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.930911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.930911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.930911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.931225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.931225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.934104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.935988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:34.943384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1166/2303] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:34.947753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.953266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b744b6-12d5-4f9a-8486-c4ef7aca70cd admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.963398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed4a839-394a-46a1-81b2-624374d7db97 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.963748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.963748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.963748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.963748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] PATH_INFO: `/v3/projects/8807c606663d46c2b9b8441aea83def0` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.964107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8807c606663d46c2b9b8441aea83def0)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.964107 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.965277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.965951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:34.966239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:34.966572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:34.967332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:34.969035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:34.980050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1167/2304] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:34.983950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:34.993999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0994bf19-a3a7-41c5-a642-29430b64cc21 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:34.999184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fc898c-db4c-44a4-8c30-1456dff4b0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:34.999850 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc898c-db4c-44a4-8c30-1456dff4b0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.000139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc898c-db4c-44a4-8c30-1456dff4b0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.000457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fc898c-db4c-44a4-8c30-1456dff4b0bd admin admin] PATH_INFO: `/v3/projects/00d5281521374d85867b3cef4e771251/users/0b405d68543a46dfb7bebd52653e2b29/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.020703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc898c-db4c-44a4-8c30-1456dff4b0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=00d5281521374d85867b3cef4e771251, user_id=0b405d68543a46dfb7bebd52653e2b29, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:35.022216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fc898c-db4c-44a4-8c30-1456dff4b0bd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:35.206828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1168/2305] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:34 2022] PUT /identity/v3/projects/00d5281521374d85867b3cef4e771251/users/0b405d68543a46dfb7bebd52653e2b29/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:35.218142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8807c606663d46c2b9b8441aea83def0', 'request_id': 'req-240691e6-e489-40d4-a9a9-c7d05861e124'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.219442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d88ee-1661-4d96-876c-0ff7e5f972c2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.219842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d88ee-1661-4d96-876c-0ff7e5f972c2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.220171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d88ee-1661-4d96-876c-0ff7e5f972c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.225612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8807c606663d46c2b9b8441aea83def0', 'request_id': 'req-240691e6-e489-40d4-a9a9-c7d05861e124'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.231802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8807c606663d46c2b9b8441aea83def0', 'request_id': 'req-240691e6-e489-40d4-a9a9-c7d05861e124'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.251403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-279d88ee-1661-4d96-876c-0ff7e5f972c2 None None] MFA Rules not processed for user `0b405d68543a46dfb7bebd52653e2b29`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:35.253663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-279d88ee-1661-4d96-876c-0ff7e5f972c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:35.329102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] The token cache is being invalidate because project 8807c606663d46c2b9b8441aea83def0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:35.329518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.330430 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.332125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1138/2306] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:34 2022] DELETE /identity/v3/projects/8807c606663d46c2b9b8441aea83def0 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:35.336126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:35.337645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:35.342687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1169/2307] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:35 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:35.343717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d88ee-1661-4d96-876c-0ff7e5f972c2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:35.409137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d88ee-1661-4d96-876c-0ff7e5f972c2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:35.413977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:35.415146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.415269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.415459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.416521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240691e6-e489-40d4-a9a9-c7d05861e124 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:35.416661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:35.418629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:35.421680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:35.422420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.422721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.423015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] PATH_INFO: `/v3/users/3c23c203e4494b7aaa6474d7d7b38056` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.425497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c23c203e4494b7aaa6474d7d7b38056)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:35.427772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:35.443878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:35.524660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1170/2308] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:35 2022] POST /identity/v3/projects => generated 397 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:35.529584 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:35.531668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:35.611040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6087040f-7ab2-4b2d-9019-6ad939c4ddf5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:35.615835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:35.616448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.616731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.617007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.617628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:35.619661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:35.659245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c23c203e4494b7aaa6474d7d7b38056'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.659245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c23c203e4494b7aaa6474d7d7b38056'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.709267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1171/2309] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:35 2022] POST /identity/v3/users => generated 305 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:35.710493 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:35.721446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c23c203e4494b7aaa6474d7d7b38056'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.726529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23948b6-19ca-4419-a7ef-9e383690b646 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:35.732769 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:35.733570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.733697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.733970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.734609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:35.734713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c23c203e4494b7aaa6474d7d7b38056'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.736314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:35.742235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c23c203e4494b7aaa6474d7d7b38056'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:35.747048 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1172/2310] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:35.749916 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1139/2311] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:35 2022] DELETE /identity/v3/users/3c23c203e4494b7aaa6474d7d7b38056 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:35.751420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:35.753083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:35.767013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff62fd-4a00-4091-93bd-53b45e632a5f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:35.795506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:35.834700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:35.835316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.835600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.835884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] PATH_INFO: `/v3/projects/a9ef8b8b92a24518bf422d4ae02b8337/users/0987565759894df38bcf319b884436b6/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.851611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ef8b8b92a24518bf422d4ae02b8337, user_id=0987565759894df38bcf319b884436b6, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:35.854387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:35.861115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:35.917356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1173/2312] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:35 2022] PUT /identity/v3/projects/a9ef8b8b92a24518bf422d4ae02b8337/users/0987565759894df38bcf319b884436b6/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:35.921370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:35.932116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbaf13f-4d4b-46fe-8a75-4d023ab9c3a9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:35.996755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba97f8a1-49fa-4431-9f94-3d044b1ce88e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:35.997564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97f8a1-49fa-4431-9f94-3d044b1ce88e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:35.997853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97f8a1-49fa-4431-9f94-3d044b1ce88e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:35.998128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba97f8a1-49fa-4431-9f94-3d044b1ce88e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:35.998839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97f8a1-49fa-4431-9f94-3d044b1ce88e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:36.006289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba97f8a1-49fa-4431-9f94-3d044b1ce88e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:36.012514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1140/2313] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:35 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:36.016817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:36.062827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55d1026-bb9f-458c-b8e2-bf33f95c5846 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:36.067939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:36.068728 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.069075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.069446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] PATH_INFO: `/v3/projects/a9ef8b8b92a24518bf422d4ae02b8337/users/0987565759894df38bcf319b884436b6/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.071714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9ef8b8b92a24518bf422d4ae02b8337, user_id=0987565759894df38bcf319b884436b6, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:36.075096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:36.086263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1174/2314] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:36 2022] PUT /identity/v3/projects/a9ef8b8b92a24518bf422d4ae02b8337/users/0987565759894df38bcf319b884436b6/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:36.096651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.096949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.097229 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.132194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] MFA Rules not processed for user `0987565759894df38bcf319b884436b6`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:36.133533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:36.211443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:36.213493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1141/2315] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:36 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:36.217447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:36.224864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:36.226976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:36.255641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:36.283937 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:36.297405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f1879c-452b-4f9b-b102-073f8cafe3e5 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:36.298786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9de956-b707-44bf-995d-9ee1e79598f3 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:36.301241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe9dc0c-685b-4eda-8692-f4c029301fb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:36.301858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9dc0c-685b-4eda-8692-f4c029301fb5 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.302143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9dc0c-685b-4eda-8692-f4c029301fb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.302421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe9dc0c-685b-4eda-8692-f4c029301fb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.304107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:36.304986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.305346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.305692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] PATH_INFO: `/v3/projects/c3173202a2ce43bebe3ab344985aa265` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.307490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3173202a2ce43bebe3ab344985aa265)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:36.309486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:36.312699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9dc0c-685b-4eda-8692-f4c029301fb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:36.314135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe9dc0c-685b-4eda-8692-f4c029301fb5 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:36.324186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1142/2316] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:36 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:36.435967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3173202a2ce43bebe3ab344985aa265', 'request_id': 'req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:36.442499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3173202a2ce43bebe3ab344985aa265', 'request_id': 'req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:36.524330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3173202a2ce43bebe3ab344985aa265', 'request_id': 'req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:36.537602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] The token cache is being invalidate because project c3173202a2ce43bebe3ab344985aa265 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:36.537897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:36.538675 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:36.540440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1175/2317] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:36 2022] DELETE /identity/v3/projects/c3173202a2ce43bebe3ab344985aa265 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:36.547739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458d49-dacb-4a55-aafc-1442c04082ea None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.550994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458d49-dacb-4a55-aafc-1442c04082ea None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.550994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d458d49-dacb-4a55-aafc-1442c04082ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.574571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:36.576163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:36.576819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7d458d49-dacb-4a55-aafc-1442c04082ea None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:36.578029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7d458d49-dacb-4a55-aafc-1442c04082ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:36.653504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ddf27b-d0cb-45f3-950c-0130d1805b8b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:36.658173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:36.662830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.662830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.662830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.662830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:36.680978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1143/2318] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:36.688852 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482e39-4612-4f44-b9d7-63b74b4daf3a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.691039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482e39-4612-4f44-b9d7-63b74b4daf3a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.691388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b482e39-4612-4f44-b9d7-63b74b4daf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.730743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-2b482e39-4612-4f44-b9d7-63b74b4daf3a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:36.736321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2b482e39-4612-4f44-b9d7-63b74b4daf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:36.746925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1144/2319] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:36.749695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:36.751242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:36.751575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482e39-4612-4f44-b9d7-63b74b4daf3a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:36.776930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b482e39-4612-4f44-b9d7-63b74b4daf3a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:36.778523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1176/2320] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:36 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:36.787501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:36.788402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.788762 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.794881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.799385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:36.799385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:36.799385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:36.826820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1145/2321] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:36.834563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:36.846600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e60af-f8e9-4549-95a6-cc80901a67ce service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:36.852333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:36.852985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:36.854240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:36.854872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:36.855543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:36.857261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:36.860865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:36.883369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:36.993272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1177/2322] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:36 2022] POST /identity/v3/projects => generated 385 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:36.997802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:37.008011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311de6fe-dda5-4ec2-87a7-f674e0b7be81 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:37.078659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:37.079743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:37.080208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:37.080487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:37.081255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:37.083839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:37.244137 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1146/2323] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:36 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:37.248246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:37.259506 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698ffef7-2e75-44d8-93fb-9f61a84fe72a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:37.264864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:37.265475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:37.265782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:37.266036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:37.266687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:37.268307 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:37.279975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1178/2324] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:37.284365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:37.294634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21efa1-aa26-4761-8221-9e94b26e5f0d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:37.302957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5f093-6f0d-43d8-b095-2f8bdf726ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:37.302957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f093-6f0d-43d8-b095-2f8bdf726ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:37.302957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f093-6f0d-43d8-b095-2f8bdf726ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:37.302957 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5f093-6f0d-43d8-b095-2f8bdf726ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:37.308776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5f093-6f0d-43d8-b095-2f8bdf726ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:37.308776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba5f093-6f0d-43d8-b095-2f8bdf726ec8 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:37.320372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1147/2325] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:37 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:37.325239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:37.335508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b41b9b-b702-4683-9dce-c7200b94a658 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:37.340672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:37.341397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:37.341715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:37.342102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] PATH_INFO: `/v3/projects/9dde21ca3e704d59952d148030125a30/users/8f6ed340246c4da78a77817338042956/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:37.367153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dde21ca3e704d59952d148030125a30, user_id=8f6ed340246c4da78a77817338042956, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:37.370418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:37.484599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1179/2326] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:37 2022] PUT /identity/v3/projects/9dde21ca3e704d59952d148030125a30/users/8f6ed340246c4da78a77817338042956/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:37.495296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dd3de-e866-4e22-b7f2-021953b25a7c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:37.495528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dd3de-e866-4e22-b7f2-021953b25a7c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:37.495823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dd3de-e866-4e22-b7f2-021953b25a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:37.523035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d07dd3de-e866-4e22-b7f2-021953b25a7c None None] MFA Rules not processed for user `8f6ed340246c4da78a77817338042956`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:37.524286 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d07dd3de-e866-4e22-b7f2-021953b25a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:37.587168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1148/2327] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:37 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:37.598997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:37.600805 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:37.666730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21684a7-c0b0-4687-9a31-531ad07517fe admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:37.670668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d290d7-7def-4d6a-93b6-5c754d3cdec1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:37.671281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d290d7-7def-4d6a-93b6-5c754d3cdec1 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:37.671851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d290d7-7def-4d6a-93b6-5c754d3cdec1 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:37.672020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d290d7-7def-4d6a-93b6-5c754d3cdec1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:37.678511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:37.684239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d290d7-7def-4d6a-93b6-5c754d3cdec1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:37.685712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d290d7-7def-4d6a-93b6-5c754d3cdec1 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:37.696271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1180/2328] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:37.719829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:37.721568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dd3de-e866-4e22-b7f2-021953b25a7c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:37.789147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dd3de-e866-4e22-b7f2-021953b25a7c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:37.794396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:37.802952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:37.802952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:37.802952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] PATH_INFO: `/v3/users/8f6ed340246c4da78a77817338042956` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:37.802952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6ed340246c4da78a77817338042956)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:37.802952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:37.981418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:38.029960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6ed340246c4da78a77817338042956'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:38.030608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6ed340246c4da78a77817338042956'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:38.146456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6ed340246c4da78a77817338042956'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:38.159544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6ed340246c4da78a77817338042956'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:38.166313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6ed340246c4da78a77817338042956'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:38.172258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1149/2329] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:37 2022] DELETE /identity/v3/users/8f6ed340246c4da78a77817338042956 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:38.176790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:38.177081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:38.177369 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:38.197223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:38.199035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:38.262514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1181/2330] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:38.272443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:38.277407 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:38.340967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10957988-44d6-4033-a5f3-2bac5b2b5d39 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:38.345011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb7f917-ef4e-4edb-b367-4958309e0628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:38.345715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f917-ef4e-4edb-b367-4958309e0628 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:38.346020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f917-ef4e-4edb-b367-4958309e0628 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:38.354653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb7f917-ef4e-4edb-b367-4958309e0628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:38.355778 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7f917-ef4e-4edb-b367-4958309e0628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:38.357257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb7f917-ef4e-4edb-b367-4958309e0628 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:38.367827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1150/2331] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:38.672751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:38.752637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:38.849153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:38.851700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:38.872359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b80b20-53cb-453a-b77a-6566a7430fc7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:38.891963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:38.892662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:38.892947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:38.893225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] PATH_INFO: `/v3/projects/9dde21ca3e704d59952d148030125a30` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:38.894396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dde21ca3e704d59952d148030125a30)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:38.896370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:39.011933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dde21ca3e704d59952d148030125a30', 'request_id': 'req-3b064ed3-941a-4125-9200-d4190ebfe528'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:39.018436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dde21ca3e704d59952d148030125a30', 'request_id': 'req-3b064ed3-941a-4125-9200-d4190ebfe528'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:39.130055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dde21ca3e704d59952d148030125a30', 'request_id': 'req-3b064ed3-941a-4125-9200-d4190ebfe528'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:39.145863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] The token cache is being invalidate because project 9dde21ca3e704d59952d148030125a30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:39.146426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:39.147201 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3b064ed3-941a-4125-9200-d4190ebfe528 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:39.148817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1182/2332] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:38 2022] DELETE /identity/v3/projects/9dde21ca3e704d59952d148030125a30 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:39.161339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b286-d300-429a-9ffc-f9bbc59adf2a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.161630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b286-d300-429a-9ffc-f9bbc59adf2a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.161911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7210b286-d300-429a-9ffc-f9bbc59adf2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.175329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:39.182676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7210b286-d300-429a-9ffc-f9bbc59adf2a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:39.183928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7210b286-d300-429a-9ffc-f9bbc59adf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:39.246718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1151/2333] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:39.256868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aab20-4397-4704-bf39-42c1fb7c2e30 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.257172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aab20-4397-4704-bf39-42c1fb7c2e30 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.257840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91aab20-4397-4704-bf39-42c1fb7c2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.278067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-e91aab20-4397-4704-bf39-42c1fb7c2e30 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:39.279390 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e91aab20-4397-4704-bf39-42c1fb7c2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:39.287861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1183/2334] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:39.292374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b286-d300-429a-9ffc-f9bbc59adf2a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:39.303193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7210b286-d300-429a-9ffc-f9bbc59adf2a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:39.308491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:39.309227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.309493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.310214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.310489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:39.310871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:39.312532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:39.326984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1152/2335] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:59:39.330631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aab20-4397-4704-bf39-42c1fb7c2e30 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:39.341938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91aab20-4397-4704-bf39-42c1fb7c2e30 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:39.346964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:39.347574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.347862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.348144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.348795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:39.350713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:39.353284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:39.455437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1184/2336] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:39 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:39.456905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:39.468304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5722234-8dcd-4845-b4d1-6435f12e7401 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:39.533809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:39.534431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.534716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.535026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.535676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:39.537654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:39.644454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1153/2337] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:39 2022] POST /identity/v3/users => generated 291 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:39.648708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:39.659340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078a8ff-afe2-44b2-8b19-a888cb53ee92 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:39.664303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:39.666602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.666602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.666602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.666602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:39.671641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:39.678086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1185/2338] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:39.682643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:39.693044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b230dc9c-6a71-41eb-b36b-a6fb3209c167 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:39.699251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ba7ec0-6341-4e1f-a9e2-0fc016fc30a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:39.700003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7ec0-6341-4e1f-a9e2-0fc016fc30a6 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.700293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7ec0-6341-4e1f-a9e2-0fc016fc30a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.700577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ba7ec0-6341-4e1f-a9e2-0fc016fc30a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.701287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba7ec0-6341-4e1f-a9e2-0fc016fc30a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:39.703088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ba7ec0-6341-4e1f-a9e2-0fc016fc30a6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:39.718209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1154/2339] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:39.721029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:39.733180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab94dece-9027-43db-8f56-7fb334999447 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:39.736764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:39.746746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:39.746746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.746746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.746746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] PATH_INFO: `/v3/projects/d69fb969a1ed4cc6b538a71d4119fdcd/users/89133e924ac3404190ecff205bb0760c/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.763552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] RBAC: Authorizing `identity:create_grant(project_id=d69fb969a1ed4cc6b538a71d4119fdcd, user_id=89133e924ac3404190ecff205bb0760c, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:39.769778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:39.856057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1186/2340] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:39 2022] PUT /identity/v3/projects/d69fb969a1ed4cc6b538a71d4119fdcd/users/89133e924ac3404190ecff205bb0760c/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:39.866566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:39.867411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:39.867411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:39.889929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:39.898244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] MFA Rules not processed for user `89133e924ac3404190ecff205bb0760c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:39.899576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:39.969675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1155/2341] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:39.980915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:39.982689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:40.039442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a41bf5-f352-405d-827c-26d62e423edc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:40.043550 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596640ce-99b7-4b8f-8312-601dc9650ad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:40.044152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596640ce-99b7-4b8f-8312-601dc9650ad8 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:40.044432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596640ce-99b7-4b8f-8312-601dc9650ad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:40.044705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596640ce-99b7-4b8f-8312-601dc9650ad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:40.052810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596640ce-99b7-4b8f-8312-601dc9650ad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:40.054288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596640ce-99b7-4b8f-8312-601dc9650ad8 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:40.063484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1187/2342] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:40.078315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:40.341336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:40.478751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:41.301431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:41.427197 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:42.028387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:42.125009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:42.349065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:42.350597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:42.417135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe2909b-25ac-4b78-9147-6b37fd0bdd9d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:42.422021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:42.422835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:42.423118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:42.423389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] PATH_INFO: `/v3/users/0b405d68543a46dfb7bebd52653e2b29` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:42.426114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b405d68543a46dfb7bebd52653e2b29)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:42.428303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:42.640835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b405d68543a46dfb7bebd52653e2b29'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:42.641719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b405d68543a46dfb7bebd52653e2b29'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:42.661772 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:42.748388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b405d68543a46dfb7bebd52653e2b29'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:42.761155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b405d68543a46dfb7bebd52653e2b29'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:42.768441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b405d68543a46dfb7bebd52653e2b29'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:42.774956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1156/2343] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:42 2022] DELETE /identity/v3/users/0b405d68543a46dfb7bebd52653e2b29 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:42.780228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:42.781625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:42.781625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:42.801789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:42.803085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:42.864432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1188/2344] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:42.875074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:42.876493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:42.936490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f649b6-fe06-4d9f-94ad-a089a8ace4b8 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:42.940233 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:42.940841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:42.941124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:42.941400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:42.951560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:42.952998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:42.962526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1157/2345] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:43.392966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:43.461363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:43.468066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:43.470211 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:43.491253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d7c160-f126-48da-9337-61c05ee8b453 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:43.499265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:43.499379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:43.499720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:43.500061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] PATH_INFO: `/v3/projects/00d5281521374d85867b3cef4e771251` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:43.501284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] RBAC: Authorizing `identity:delete_project(project_id=00d5281521374d85867b3cef4e771251)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:43.503343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:43.689250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00d5281521374d85867b3cef4e771251', 'request_id': 'req-dda7f00b-8efd-4774-a98d-40793072509b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:43.705062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00d5281521374d85867b3cef4e771251', 'request_id': 'req-dda7f00b-8efd-4774-a98d-40793072509b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:43.782860 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00d5281521374d85867b3cef4e771251', 'request_id': 'req-dda7f00b-8efd-4774-a98d-40793072509b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:43.796109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] The token cache is being invalidate because project 00d5281521374d85867b3cef4e771251 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:43.796637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:43.797748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:43.800218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1189/2346] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:43 2022] DELETE /identity/v3/projects/00d5281521374d85867b3cef4e771251 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:43.804089 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:43.815458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13471087-56bb-4e1c-bf5e-5e2491c3e126 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:43.888824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:43.889482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:43.889765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:43.890047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] PATH_INFO: `/v3/users/0987565759894df38bcf319b884436b6` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:43.891547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0987565759894df38bcf319b884436b6)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:43.893729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:44.093006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0987565759894df38bcf319b884436b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:44.093676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0987565759894df38bcf319b884436b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:44.183306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0987565759894df38bcf319b884436b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:44.205183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0987565759894df38bcf319b884436b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:44.214922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a1f0bbac-22b3-4865-ac0f-036970aa81d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0987565759894df38bcf319b884436b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:44.221516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1158/2347] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:43 2022] DELETE /identity/v3/users/0987565759894df38bcf319b884436b6 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:44.617164 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:44.738794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:44.741002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:44.743308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:44.757954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda7f00b-8efd-4774-a98d-40793072509b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:44.821463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:44.822189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:44.822473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:44.823372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] PATH_INFO: `/v3/projects/a9ef8b8b92a24518bf422d4ae02b8337` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:44.824741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9ef8b8b92a24518bf422d4ae02b8337)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:44.826659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:44.926962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9ef8b8b92a24518bf422d4ae02b8337', 'request_id': 'req-53d9c848-5897-47c1-87ee-8889b9a563e4'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:44.934053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9ef8b8b92a24518bf422d4ae02b8337', 'request_id': 'req-53d9c848-5897-47c1-87ee-8889b9a563e4'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:45.018717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9ef8b8b92a24518bf422d4ae02b8337', 'request_id': 'req-53d9c848-5897-47c1-87ee-8889b9a563e4'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:45.032950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] The token cache is being invalidate because project a9ef8b8b92a24518bf422d4ae02b8337 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:45.033536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:45.034393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-53d9c848-5897-47c1-87ee-8889b9a563e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:45.036640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1190/2348] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:44 2022] DELETE /identity/v3/projects/a9ef8b8b92a24518bf422d4ae02b8337 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:45.040987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6565ee-7706-4a2c-8d9c-d62385fedd8b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.041478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6565ee-7706-4a2c-8d9c-d62385fedd8b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.041572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6565ee-7706-4a2c-8d9c-d62385fedd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.061545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-da6565ee-7706-4a2c-8d9c-d62385fedd8b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:45.063561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-da6565ee-7706-4a2c-8d9c-d62385fedd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:45.140645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1159/2349] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:45.147625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965613b-afc9-416f-bbb6-591aa0b9a919 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.147976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965613b-afc9-416f-bbb6-591aa0b9a919 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.148367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c965613b-afc9-416f-bbb6-591aa0b9a919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.170753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c965613b-afc9-416f-bbb6-591aa0b9a919 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:45.172774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c965613b-afc9-416f-bbb6-591aa0b9a919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:45.182049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1191/2350] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:45.187098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6565ee-7706-4a2c-8d9c-d62385fedd8b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:45.201828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6565ee-7706-4a2c-8d9c-d62385fedd8b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:45.207260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:45.207873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.208151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.208656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.209543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:45.210203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:45.212613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:45.225405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1160/2351] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:45.229840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965613b-afc9-416f-bbb6-591aa0b9a919 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:45.239206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c965613b-afc9-416f-bbb6-591aa0b9a919 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:45.244019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:45.244612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.244893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.245209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.246352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:45.248501 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:45.389013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1192/2352] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:45 2022] POST /identity/v3/projects => generated 387 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:45.393212 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:45.403542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaecd7d-e070-4480-8ce3-c8d6e8887bd5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:45.471471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:45.472075 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.472354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.472627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.475260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:45.475260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:45.593743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1161/2353] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:45 2022] POST /identity/v3/users => generated 294 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:45.598625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:45.609788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847634-6ce2-4520-95d0-7942e9d8e344 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:45.614512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:45.615130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.615417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.615697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.616347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:45.617980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:45.628648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1193/2354] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:45.632763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:45.643498 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6d8ef-46ff-4a07-a605-4fbabc6aed50 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:45.648400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea96c9e-87fb-44c3-863e-59fbe1c71605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:45.649070 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96c9e-87fb-44c3-863e-59fbe1c71605 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.649387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96c9e-87fb-44c3-863e-59fbe1c71605 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.649717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea96c9e-87fb-44c3-863e-59fbe1c71605 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.650330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea96c9e-87fb-44c3-863e-59fbe1c71605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:45.651981 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea96c9e-87fb-44c3-863e-59fbe1c71605 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:45.664024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1162/2355] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:45.668986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:45.680565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c756f41-84be-46bb-b2be-a40470aeb3d4 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:45.686408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:45.687113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.687397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.687671 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] PATH_INFO: `/v3/projects/7369d55b391c4470a955257c4f02b8db/users/239727523a814a24a2ac8d49b6791428/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.704398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7369d55b391c4470a955257c4f02b8db, user_id=239727523a814a24a2ac8d49b6791428, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:45.707188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:45.833443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1194/2356] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:45 2022] PUT /identity/v3/projects/7369d55b391c4470a955257c4f02b8db/users/239727523a814a24a2ac8d49b6791428/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:45.844790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0497-f36f-4568-8e76-cafe99cdc4be None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:45.845084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0497-f36f-4568-8e76-cafe99cdc4be None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:45.845370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0497-f36f-4568-8e76-cafe99cdc4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:45.874252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-d99f0497-f36f-4568-8e76-cafe99cdc4be None None] MFA Rules not processed for user `239727523a814a24a2ac8d49b6791428`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:45.875477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-d99f0497-f36f-4568-8e76-cafe99cdc4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:45.940019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1163/2357] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:45.944541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:46.006177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2761412-04ca-4112-9d45-45e903eba0b0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:46.011951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:46.012554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.012840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.013119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.013755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:46.015751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:46.127734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1195/2358] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:45 2022] POST /identity/v3/projects => generated 389 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:46.131817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0497-f36f-4568-8e76-cafe99cdc4be None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:46.153805 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99f0497-f36f-4568-8e76-cafe99cdc4be None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:46.222454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:46.251158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:46.252027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.252314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.252749 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.253432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:46.255726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:46.314436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1164/2359] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:46 2022] POST /identity/v3/users => generated 301 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:46.318758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:46.330259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee9eac6-d390-448c-a132-c3488d6d474d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:46.334935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:46.335549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.337861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.337861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.337861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:46.338587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:46.350333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1196/2360] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:46.354583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:46.364840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e335b-ce0a-4e49-adee-3f7e077d510d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:46.369968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:46.370644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.374012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.374012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] PATH_INFO: `/v3/projects/96236f5bdb5c4c57934456c2e51fb668/users/95654b5999fc4662b4a7c6aab0314508/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.388411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96236f5bdb5c4c57934456c2e51fb668, user_id=95654b5999fc4662b4a7c6aab0314508, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:46.391182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:46.466384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1165/2361] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:46 2022] PUT /identity/v3/projects/96236f5bdb5c4c57934456c2e51fb668/users/95654b5999fc4662b4a7c6aab0314508/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:46.469482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:46.489548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be7641-625c-4ed6-9776-0d0ce07e4a67 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:46.549546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cf4f1e-94d2-4788-ad6c-d4c524d9aac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:46.550165 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4f1e-94d2-4788-ad6c-d4c524d9aac4 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.550450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4f1e-94d2-4788-ad6c-d4c524d9aac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.550727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cf4f1e-94d2-4788-ad6c-d4c524d9aac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.551409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4f1e-94d2-4788-ad6c-d4c524d9aac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:46.553234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cf4f1e-94d2-4788-ad6c-d4c524d9aac4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:46.563752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1197/2362] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:46.567879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:46.579228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556abd21-ee9f-4ea0-9c35-42cbb53b8b85 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:46.584462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:46.585124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.585407 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.585685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] PATH_INFO: `/v3/projects/96236f5bdb5c4c57934456c2e51fb668/users/95654b5999fc4662b4a7c6aab0314508/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.587785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96236f5bdb5c4c57934456c2e51fb668, user_id=95654b5999fc4662b4a7c6aab0314508, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:46.591177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:46.601421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1166/2363] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:46 2022] PUT /identity/v3/projects/96236f5bdb5c4c57934456c2e51fb668/users/95654b5999fc4662b4a7c6aab0314508/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:46.611878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8c13-94f0-453a-81a1-09601f228367 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.612183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8c13-94f0-453a-81a1-09601f228367 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.612494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee8c13-94f0-453a-81a1-09601f228367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.640851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-fdee8c13-94f0-453a-81a1-09601f228367 None None] MFA Rules not processed for user `95654b5999fc4662b4a7c6aab0314508`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:46.641797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fdee8c13-94f0-453a-81a1-09601f228367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:46.651280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:46.714302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1198/2364] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:46 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:46.783753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:46.785713 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:46.855777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a60cba-d7b4-49f5-9457-57e07e759312 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:46.855777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852f041-617a-482d-ac1e-7800773ccbb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:46.855777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f041-617a-482d-ac1e-7800773ccbb5 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:46.855777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f041-617a-482d-ac1e-7800773ccbb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:46.856135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852f041-617a-482d-ac1e-7800773ccbb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:46.864005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852f041-617a-482d-ac1e-7800773ccbb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:46.865358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852f041-617a-482d-ac1e-7800773ccbb5 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:46.875641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1167/2365] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:46 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:47.059589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8c13-94f0-453a-81a1-09601f228367 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:47.128900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee8c13-94f0-453a-81a1-09601f228367 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:47.133916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:47.134757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:47.134927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:47.135204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] PATH_INFO: `/v3/users/239727523a814a24a2ac8d49b6791428` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:47.136522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] RBAC: Authorizing `identity:delete_user(user_id=239727523a814a24a2ac8d49b6791428)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:47.138801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:47.301246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '239727523a814a24a2ac8d49b6791428'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:47.301950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '239727523a814a24a2ac8d49b6791428'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:47.353676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '239727523a814a24a2ac8d49b6791428'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:47.362370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '239727523a814a24a2ac8d49b6791428'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:47.375439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '239727523a814a24a2ac8d49b6791428'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:47.381632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1199/2366] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:47 2022] DELETE /identity/v3/users/239727523a814a24a2ac8d49b6791428 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:47.386388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:47.386966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:47.387063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:47.409481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:47.410912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:47.474528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1168/2367] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:47.485435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:47.486992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:47.548699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3a6be-37c8-49b4-8f54-d7401dcd74be admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:47.554579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:47.554579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:47.554579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:47.554579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:47.564411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:47.566143 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:47.577285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1200/2368] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:47.702757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:47.766341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:47.894919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:47.896463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:47.909735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a89e62f-65d1-4d52-a39a-c49fa01fda8c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:47.914812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:47.915597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:47.915751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:47.916027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] PATH_INFO: `/v3/users/89133e924ac3404190ecff205bb0760c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:47.917206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] RBAC: Authorizing `identity:delete_user(user_id=89133e924ac3404190ecff205bb0760c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:47.919429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:48.118875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89133e924ac3404190ecff205bb0760c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.119670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89133e924ac3404190ecff205bb0760c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.194757 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:48.200753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:48.204462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89133e924ac3404190ecff205bb0760c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.205700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:48.221764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89133e924ac3404190ecff205bb0760c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.237774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-dd3d3c8d-a459-4801-ba3e-a75f028a497f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89133e924ac3404190ecff205bb0760c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.245191 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1169/2369] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:47 2022] DELETE /identity/v3/users/89133e924ac3404190ecff205bb0760c => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:48.259138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:48.259138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:48.259138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:48.266081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88307f4c-cddb-4b08-a046-b22dd918cf04 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:48.283564 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:48.285711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:48.331230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:48.331880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:48.332166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:48.332504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] PATH_INFO: `/v3/projects/7369d55b391c4470a955257c4f02b8db` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:48.334074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7369d55b391c4470a955257c4f02b8db)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:48.336077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:48.381414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1170/2370] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:48.393403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:48.395542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:48.407452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:48.463188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2068-b9bd-4047-8c39-4d475a54652d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:48.476236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:48.476236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:48.476236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:48.476236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:48.478719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:48.481557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:48.495090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1171/2371] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:48.527028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7369d55b391c4470a955257c4f02b8db', 'request_id': 'req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.533415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7369d55b391c4470a955257c4f02b8db', 'request_id': 'req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.599969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7369d55b391c4470a955257c4f02b8db', 'request_id': 'req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.612378 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] The token cache is being invalidate because project 7369d55b391c4470a955257c4f02b8db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:48.613274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.613943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:48.615535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1201/2372] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:48 2022] DELETE /identity/v3/projects/7369d55b391c4470a955257c4f02b8db => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:48.619880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:48.622837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:48.644652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa92c3b-2d60-4bf6-ba7f-97286bd6a2b9 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:48.781333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:48.782620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:48.783773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:48.784275 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] PATH_INFO: `/v3/users/95654b5999fc4662b4a7c6aab0314508` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:48.786303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95654b5999fc4662b4a7c6aab0314508)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:48.791670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:49.005254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:49.006737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:49.013739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95654b5999fc4662b4a7c6aab0314508'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.014835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95654b5999fc4662b4a7c6aab0314508'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.023611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6ee628-5ff6-4a8d-8549-02ee70a420e9 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:49.029177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:49.030978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:49.030978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:49.030978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] PATH_INFO: `/v3/projects/d69fb969a1ed4cc6b538a71d4119fdcd` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:49.031992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d69fb969a1ed4cc6b538a71d4119fdcd)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:49.034179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:49.120151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95654b5999fc4662b4a7c6aab0314508'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.133394 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95654b5999fc4662b4a7c6aab0314508'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.140639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b3b05df2-7f76-4842-8c40-b9c27c6a64a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95654b5999fc4662b4a7c6aab0314508'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.147504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1172/2373] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:48 2022] DELETE /identity/v3/users/95654b5999fc4662b4a7c6aab0314508 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:49.183579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd69fb969a1ed4cc6b538a71d4119fdcd', 'request_id': 'req-1f6b8910-fc46-45a4-85d2-296bc281be5c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.190831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd69fb969a1ed4cc6b538a71d4119fdcd', 'request_id': 'req-1f6b8910-fc46-45a4-85d2-296bc281be5c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.353516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd69fb969a1ed4cc6b538a71d4119fdcd', 'request_id': 'req-1f6b8910-fc46-45a4-85d2-296bc281be5c'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.366909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] The token cache is being invalidate because project d69fb969a1ed4cc6b538a71d4119fdcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:49.367430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.368091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1f6b8910-fc46-45a4-85d2-296bc281be5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:49.369658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1202/2374] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:49 2022] DELETE /identity/v3/projects/d69fb969a1ed4cc6b538a71d4119fdcd => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:49.375332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1c66-903f-4e86-b62a-add7e9e56cc3 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:49.375647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1c66-903f-4e86-b62a-add7e9e56cc3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:49.375928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f1c66-903f-4e86-b62a-add7e9e56cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:49.395439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e28f1c66-903f-4e86-b62a-add7e9e56cc3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:49.396689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e28f1c66-903f-4e86-b62a-add7e9e56cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:49.456467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1173/2375] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:49.464498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a17b1e-ac3b-488d-b254-f473fe055014 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:49.464859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a17b1e-ac3b-488d-b254-f473fe055014 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:49.465212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a17b1e-ac3b-488d-b254-f473fe055014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:49.488680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-27a17b1e-ac3b-488d-b254-f473fe055014 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:49.489915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-27a17b1e-ac3b-488d-b254-f473fe055014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:49.505259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1203/2376] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:49.509735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1c66-903f-4e86-b62a-add7e9e56cc3 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:49.519984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f1c66-903f-4e86-b62a-add7e9e56cc3 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:49.525453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:49.526079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:49.526481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:49.526790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:49.527457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:49.527795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:49.529422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:49.531683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:49.542801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1174/2377] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:49.547752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a17b1e-ac3b-488d-b254-f473fe055014 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:49.558171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a17b1e-ac3b-488d-b254-f473fe055014 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:49.564775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:49.565391 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:49.565896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:49.566125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:49.566678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:49.568706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:49.588888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:49.698905 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:49.700923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:49.717963 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1204/2378] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:49 2022] POST /identity/v3/projects => generated 373 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:49.724594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:49.724966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9884b-ee9c-429a-b935-d10c4b1482e6 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:49.822209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:49.823241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a08337-c12f-4617-b107-f705df023ca6 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:49.823483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:49.823760 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:49.824245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] PATH_INFO: `/v3/projects/96236f5bdb5c4c57934456c2e51fb668` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:49.825977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96236f5bdb5c4c57934456c2e51fb668)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:49.828243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:49.828858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:49.829146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:49.829430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:49.829605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:49.830070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:49.832086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:49.972931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1205/2379] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:49 2022] POST /identity/v3/users => generated 287 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:49.975685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:49.991390 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26734f3-23f1-485c-9ffb-414162b06c41 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.018036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96236f5bdb5c4c57934456c2e51fb668', 'request_id': 'req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:50.029764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:50.039478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96236f5bdb5c4c57934456c2e51fb668', 'request_id': 'req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:50.046711 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96236f5bdb5c4c57934456c2e51fb668', 'request_id': 'req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:50.077526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.078657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.078919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.079269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.079994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.081712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.094130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1206/2380] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:50.098146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.108333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1605e95-d5b8-4f34-8843-7b6fa2832db2 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.113566 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265021b6-baef-4237-875c-33d816e0a5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.114246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265021b6-baef-4237-875c-33d816e0a5a2 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.114588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265021b6-baef-4237-875c-33d816e0a5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.115123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265021b6-baef-4237-875c-33d816e0a5a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.116034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265021b6-baef-4237-875c-33d816e0a5a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.117552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265021b6-baef-4237-875c-33d816e0a5a2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.127446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] The token cache is being invalidate because project 96236f5bdb5c4c57934456c2e51fb668 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:50.130536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:50.130536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:50.130724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1207/2381] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:50.132351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1175/2382] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:49 2022] DELETE /identity/v3/projects/96236f5bdb5c4c57934456c2e51fb668 => generated 0 bytes in 434 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:50.137676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22b855-8d29-4649-a7da-40579d5c9319 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.139135 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.140716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22b855-8d29-4649-a7da-40579d5c9319 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.143283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:50.144629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a22b855-8d29-4649-a7da-40579d5c9319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.179657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bf822-ef70-4b7c-a406-8950f2b9b5b6 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.181720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-8a22b855-8d29-4649-a7da-40579d5c9319 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:50.183182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8a22b855-8d29-4649-a7da-40579d5c9319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:50.184952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1490b13f-812e-4478-b8b5-4d47ca61bf43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.185784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b13f-812e-4478-b8b5-4d47ca61bf43 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.186099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b13f-812e-4478-b8b5-4d47ca61bf43 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.186384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1490b13f-812e-4478-b8b5-4d47ca61bf43 admin admin] PATH_INFO: `/v3/projects/194562bf98ce4f10b3747080f6869ff8/users/559415f2e826476a8c677b2e6ef66d76/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.192154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1208/2383] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:50.206572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490b13f-812e-4478-b8b5-4d47ca61bf43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194562bf98ce4f10b3747080f6869ff8, user_id=559415f2e826476a8c677b2e6ef66d76, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.207111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaeb6c-5f4d-4041-875c-c650a47254f6 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.207408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaeb6c-5f4d-4041-875c-c650a47254f6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.207692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adaeb6c-5f4d-4041-875c-c650a47254f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.209310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1490b13f-812e-4478-b8b5-4d47ca61bf43 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.229242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3adaeb6c-5f4d-4041-875c-c650a47254f6 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:50.230476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3adaeb6c-5f4d-4041-875c-c650a47254f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:50.239235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1209/2384] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:50.243423 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaeb6c-5f4d-4041-875c-c650a47254f6 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.254404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adaeb6c-5f4d-4041-875c-c650a47254f6 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.259449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.260071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.260364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.260641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.261368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:50.261679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.263838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.276836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1210/2385] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 06:59:50.281443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.291784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cea8da-fbf7-451b-8d6d-d398543e1b6a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.297882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.298502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.298799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.299082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.299755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.301663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.412140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1176/2386] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:50 2022] PUT /identity/v3/projects/194562bf98ce4f10b3747080f6869ff8/users/559415f2e826476a8c677b2e6ef66d76/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:50.417323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.417685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.418068 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.441692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:50.443073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:50.462741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1211/2387] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:50 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 06:59:50.467462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.524763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1177/2388] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:50.526679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:50.539581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc8395f-ec7d-4034-8201-64ade3475836 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.544730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.545363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.545740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.546028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.546673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.547238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.548677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.548827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:50.605758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f61e5e-9740-4c34-8c76-4e016d52958a None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.654706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.655340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.655620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.655888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.665037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.666470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.676080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1178/2389] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:50.694836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1212/2390] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:50 2022] POST /identity/v3/users => generated 294 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:50.697152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.708697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1353864-4501-4124-bc26-f2509c95a426 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.713460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.714069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.714351 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.714629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.715312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.716921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.727609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1179/2391] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:50.731634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.741552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8741cb74-9de9-4fb0-b2b5-d4b1d970160a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.746166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fc9c95-9dfa-4daa-a8f0-26b50ab2cabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.747366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9c95-9dfa-4daa-a8f0-26b50ab2cabf admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.747709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9c95-9dfa-4daa-a8f0-26b50ab2cabf admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.747927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fc9c95-9dfa-4daa-a8f0-26b50ab2cabf admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.748571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc9c95-9dfa-4daa-a8f0-26b50ab2cabf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.750172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fc9c95-9dfa-4daa-a8f0-26b50ab2cabf admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.760350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1213/2392] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 06:59:50.765546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:50.776040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d14b7-6b37-4d09-9681-2622a190bf69 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:50.781629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:50.782376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.782657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.783156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] PATH_INFO: `/v3/projects/0b855e38df4b440f872b290895e6b7d8/users/723571e28213400a9a66ddfbc8456f7a/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.799440 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b855e38df4b440f872b290895e6b7d8, user_id=723571e28213400a9a66ddfbc8456f7a, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:50.802079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:50.891717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:50.942645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1180/2393] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:50 2022] PUT /identity/v3/projects/0b855e38df4b440f872b290895e6b7d8/users/723571e28213400a9a66ddfbc8456f7a/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:50.953484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde6a7-5187-4638-b6f1-a38476717f77 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:50.953775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde6a7-5187-4638-b6f1-a38476717f77 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:50.954054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cde6a7-5187-4638-b6f1-a38476717f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:50.992890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-89cde6a7-5187-4638-b6f1-a38476717f77 None None] MFA Rules not processed for user `723571e28213400a9a66ddfbc8456f7a`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:50.994244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-89cde6a7-5187-4638-b6f1-a38476717f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:51.075180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1214/2394] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:51.080131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:51.144331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d10a5-d27b-476d-aad6-19703d6cf853 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:51.149238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:51.149878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:51.150168 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:51.150445 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:51.151119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:51.153575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:51.268767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1181/2395] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:51 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:51.270625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cde6a7-5187-4638-b6f1-a38476717f77 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:51.295382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cde6a7-5187-4638-b6f1-a38476717f77 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:51.381527 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:51.382752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:51.383169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:51.383640 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:51.384305 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:51.386386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:51.526195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1215/2396] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:51 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:51.530293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:51.542055 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabc7cbf-17b4-419d-a595-68ab6e3f8999 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:51.549039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:51.549883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:51.550222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:51.550521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:51.551220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:51.553198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:51.567715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1182/2397] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:51.568962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:51.592328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9692dc3c-5612-40fd-b003-b15de3c03e6a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:51.599118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:51.599776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:51.600061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:51.600338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] PATH_INFO: `/v3/projects/10bbace959804477a3398ff865d2f421/users/166a2e8e1dd944cc9ca9a3f1e945fcce/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:51.623462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bbace959804477a3398ff865d2f421, user_id=166a2e8e1dd944cc9ca9a3f1e945fcce, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:51.626440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:51.629330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:51.734018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1216/2398] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:51 2022] PUT /identity/v3/projects/10bbace959804477a3398ff865d2f421/users/166a2e8e1dd944cc9ca9a3f1e945fcce/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:51.738133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:51.749978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78693e2f-5a2f-42d6-a8bb-ebc6e2fa7ba9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:51.832874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49b3c20-4c4b-4f90-8ca1-b8f917a7928f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:51.835074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b3c20-4c4b-4f90-8ca1-b8f917a7928f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:51.835550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b3c20-4c4b-4f90-8ca1-b8f917a7928f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:51.835897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49b3c20-4c4b-4f90-8ca1-b8f917a7928f admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:51.836638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b3c20-4c4b-4f90-8ca1-b8f917a7928f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:51.839742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49b3c20-4c4b-4f90-8ca1-b8f917a7928f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:51.859343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1183/2399] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:51 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:51.861379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:51.874459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8942fc23-e1fb-4b07-aeea-9d9555fabef3 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:51.879643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:51.880367 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:51.882499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:51.882499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] PATH_INFO: `/v3/projects/10bbace959804477a3398ff865d2f421/users/166a2e8e1dd944cc9ca9a3f1e945fcce/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:51.883007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10bbace959804477a3398ff865d2f421, user_id=166a2e8e1dd944cc9ca9a3f1e945fcce, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:51.885659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:51.896546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1217/2400] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:51 2022] PUT /identity/v3/projects/10bbace959804477a3398ff865d2f421/users/166a2e8e1dd944cc9ca9a3f1e945fcce/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:51.907721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f414097-39df-4842-ba8a-be4ed0491d66 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:51.908015 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f414097-39df-4842-ba8a-be4ed0491d66 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:51.908301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f414097-39df-4842-ba8a-be4ed0491d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:51.942755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-5f414097-39df-4842-ba8a-be4ed0491d66 None None] MFA Rules not processed for user `166a2e8e1dd944cc9ca9a3f1e945fcce`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:51.944034 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-5f414097-39df-4842-ba8a-be4ed0491d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:52.021202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1184/2401] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:52.034716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:52.036396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:52.105768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0131441c-68c2-427f-9d47-a9c37528a0b6 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:52.111864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:52.112504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:52.112825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:52.113126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:52.123696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:52.125275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:52.135548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1218/2402] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:52 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:52.192272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d713-be12-4be3-b610-10c79d7bc53b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:52.192580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d713-be12-4be3-b610-10c79d7bc53b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:52.192866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2d713-be12-4be3-b610-10c79d7bc53b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:52.225153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:52.227115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-81f2d713-be12-4be3-b610-10c79d7bc53b None None] MFA Rules not processed for user `559415f2e826476a8c677b2e6ef66d76`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:52.228604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-81f2d713-be12-4be3-b610-10c79d7bc53b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:52.302219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1185/2403] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:52.492401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:52.506898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:52.516746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8508f636-870c-4fd1-be2c-a925dd1cd73e service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:52.523821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:52.524702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:52.525147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:52.525582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:52.535582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:52.537278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:52.551707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1219/2404] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:53.600955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:53.812496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:53.953144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:53.953637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:53.953932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:54.003634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:54.004921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:54.061990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:54.082638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1186/2405] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 06:59:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:54.112047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:54.112047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:54.138470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8274f4-6a59-4c8f-b465-f2898d02f440 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:54.145079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:54.147153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:54.147153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:54.147153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] PATH_INFO: `/v3/users/723571e28213400a9a66ddfbc8456f7a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:54.148560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=723571e28213400a9a66ddfbc8456f7a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:54.150654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:54.206592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5789c7-568c-4f4a-82da-f30102368a63 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:54.212490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec321b2-1388-455a-92b2-de18352f5348 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:54.213228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec321b2-1388-455a-92b2-de18352f5348 service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:54.213510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec321b2-1388-455a-92b2-de18352f5348 service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:54.213929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec321b2-1388-455a-92b2-de18352f5348 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:54.224141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec321b2-1388-455a-92b2-de18352f5348 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:54.225766 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec321b2-1388-455a-92b2-de18352f5348 service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:54.234949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1187/2406] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 06:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 06:59:54.436470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2aaa-948b-4d9e-b3b4-70e61f156540 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:54.436810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2aaa-948b-4d9e-b3b4-70e61f156540 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:54.437231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf2aaa-948b-4d9e-b3b4-70e61f156540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:54.459134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-87cf2aaa-948b-4d9e-b3b4-70e61f156540 None None] MFA Rules not processed for user `559415f2e826476a8c677b2e6ef66d76`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:54.460069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-87cf2aaa-948b-4d9e-b3b4-70e61f156540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:54.465835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '723571e28213400a9a66ddfbc8456f7a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:54.466786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '723571e28213400a9a66ddfbc8456f7a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:54.472791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1188/2407] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:54.680810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '723571e28213400a9a66ddfbc8456f7a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:54.691572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '723571e28213400a9a66ddfbc8456f7a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:54.706613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '723571e28213400a9a66ddfbc8456f7a'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:54.717863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1220/2408] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:54 2022] DELETE /identity/v3/users/723571e28213400a9a66ddfbc8456f7a => generated 0 bytes in 656 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:54.727613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:54.727901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:54.730487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:54.761915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:54.763278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:54.869280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1189/2409] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 06:59:54.881412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:54.882989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:54.950885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:54.954212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c26dc1-3086-4ebc-8a48-491bccfbdcd6 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:54.961712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461a6cda-a7f0-4f0e-a560-e44407baa659 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:54.962368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6cda-a7f0-4f0e-a560-e44407baa659 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:54.962652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6cda-a7f0-4f0e-a560-e44407baa659 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:54.962960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461a6cda-a7f0-4f0e-a560-e44407baa659 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:54.978160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6cda-a7f0-4f0e-a560-e44407baa659 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:54.979868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461a6cda-a7f0-4f0e-a560-e44407baa659 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:54.996253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:55.005036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1221/2410] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 06:59:55.664838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:55.666337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:55.695838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb34064-2a96-4867-9fed-8bd1018492ac None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:55.702119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:55.702826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:55.703119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:55.703573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] PATH_INFO: `/v3/users/4c5a6b69f7434e048f1eae02b83037b2` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:55.704781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c5a6b69f7434e048f1eae02b83037b2)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:55.708121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:55.958285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c5a6b69f7434e048f1eae02b83037b2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:55.962988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c5a6b69f7434e048f1eae02b83037b2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.052714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c5a6b69f7434e048f1eae02b83037b2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.073463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c5a6b69f7434e048f1eae02b83037b2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.093663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c5a6b69f7434e048f1eae02b83037b2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.108788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1190/2411] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:55 2022] DELETE /identity/v3/users/4c5a6b69f7434e048f1eae02b83037b2 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:56.112933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:56.113927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:56.114131 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:56.143660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:56.145439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:56.266699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1222/2412] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:56.276167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:56.278639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:56.323263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:56.325127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:56.369903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcbf2b2-fc9a-4e22-9434-8e0e0feffbd7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:56.391687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:56.394516 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:56.395065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:56.396221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] PATH_INFO: `/v3/projects/0b855e38df4b440f872b290895e6b7d8` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:56.399925 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56250679-eb89-4f06-88bc-924bab1c1cfc admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:56.400343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b855e38df4b440f872b290895e6b7d8)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:56.404274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:56.411637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:56.412315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:56.412621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:56.412924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:56.440048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:56.441864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:56.458261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1191/2413] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:56.465033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:56.587083 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b855e38df4b440f872b290895e6b7d8', 'request_id': 'req-efaec5ec-e871-4561-9778-23694defe70d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.595111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b855e38df4b440f872b290895e6b7d8', 'request_id': 'req-efaec5ec-e871-4561-9778-23694defe70d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.687580 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:56.723178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b855e38df4b440f872b290895e6b7d8', 'request_id': 'req-efaec5ec-e871-4561-9778-23694defe70d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.741035 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] The token cache is being invalidate because project 0b855e38df4b440f872b290895e6b7d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:56.741358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.743190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:56.749901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:56.767476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1223/2414] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:56 2022] DELETE /identity/v3/projects/0b855e38df4b440f872b290895e6b7d8 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:56.772728 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194288e-4b5a-4f06-9b1e-451b13e8b170 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:56.850127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:56.850907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:56.851228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:56.851580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] PATH_INFO: `/v3/users/166a2e8e1dd944cc9ca9a3f1e945fcce` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:56.853022 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=166a2e8e1dd944cc9ca9a3f1e945fcce)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:56.855187 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:57.037776 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:57.039308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:57.078644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaec5ec-e871-4561-9778-23694defe70d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:57.105300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:57.107857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:57.108426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:57.109644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] PATH_INFO: `/v3/projects/76e36a832438477eb8aabe7e2d736335` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:57.112697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e36a832438477eb8aabe7e2d736335)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:57.122268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '166a2e8e1dd944cc9ca9a3f1e945fcce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.122268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '166a2e8e1dd944cc9ca9a3f1e945fcce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.123298 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:57.206793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '166a2e8e1dd944cc9ca9a3f1e945fcce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.242495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '166a2e8e1dd944cc9ca9a3f1e945fcce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.256826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a401a6e0-db86-4ca7-86f7-f8af205d3f33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '166a2e8e1dd944cc9ca9a3f1e945fcce'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.265597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1192/2415] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 06:59:56 2022] DELETE /identity/v3/users/166a2e8e1dd944cc9ca9a3f1e945fcce => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:57.277834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e36a832438477eb8aabe7e2d736335', 'request_id': 'req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.289983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e36a832438477eb8aabe7e2d736335', 'request_id': 'req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.347409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:57.419013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e36a832438477eb8aabe7e2d736335', 'request_id': 'req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.432406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] The token cache is being invalidate because project 76e36a832438477eb8aabe7e2d736335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:57.432693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.433417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:57.452053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1224/2416] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:57 2022] DELETE /identity/v3/projects/76e36a832438477eb8aabe7e2d736335 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:57.468324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:57.709633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d29f9-cb2f-4406-95a5-d629e1972ecd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:57.709633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d29f9-cb2f-4406-95a5-d629e1972ecd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:57.709921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d29f9-cb2f-4406-95a5-d629e1972ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:57.740895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0b6d29f9-cb2f-4406-95a5-d629e1972ecd None None] MFA Rules not processed for user `6a91e857dd3b4c1f9355b757cadd6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:57.742334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0b6d29f9-cb2f-4406-95a5-d629e1972ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:57.835273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1193/2417] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:58.477764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:58.479382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:58.551444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2c551-4ddc-4ca2-a217-30d26b649e6d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:58.618347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:58.619682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:58.619887 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:58.620313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] PATH_INFO: `/v3/projects/10bbace959804477a3398ff865d2f421` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:58.621357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10bbace959804477a3398ff865d2f421)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:58.624294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:58.803135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10bbace959804477a3398ff865d2f421', 'request_id': 'req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:58.812379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10bbace959804477a3398ff865d2f421', 'request_id': 'req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:58.882047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10bbace959804477a3398ff865d2f421', 'request_id': 'req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:58.892304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:58.897770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] The token cache is being invalidate because project 10bbace959804477a3398ff865d2f421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 06:59:58.898075 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:58.900786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a90bfd26-7640-4ea8-aaf6-07264a27f9e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 06:59:58.902379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1225/2418] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 06:59:58 2022] DELETE /identity/v3/projects/10bbace959804477a3398ff865d2f421 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 06:59:58.907406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d732dd7-3b33-4d58-b4f0-2d8c112b0b5c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:58.908194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d732dd7-3b33-4d58-b4f0-2d8c112b0b5c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:58.908476 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d732dd7-3b33-4d58-b4f0-2d8c112b0b5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:58.929604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3d732dd7-3b33-4d58-b4f0-2d8c112b0b5c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:58.930960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3d732dd7-3b33-4d58-b4f0-2d8c112b0b5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:59.015216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1194/2419] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:59.021196 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8a0a-058f-4b19-af53-b96171b561bd None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.022248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8a0a-058f-4b19-af53-b96171b561bd None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.022248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ea8a0a-058f-4b19-af53-b96171b561bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.044060 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.052180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a8ea8a0a-058f-4b19-af53-b96171b561bd None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:59.052629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a8ea8a0a-058f-4b19-af53-b96171b561bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:59.061415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1226/2420] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:59.065816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d732dd7-3b33-4d58-b4f0-2d8c112b0b5c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:59.082444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d732dd7-3b33-4d58-b4f0-2d8c112b0b5c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:59.088427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:59.089243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.089600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.089950 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.090782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 06:59:59.091160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:59.092840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:59.109398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1195/2421] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 06:59:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 06:59:59.113854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea8a0a-058f-4b19-af53-b96171b561bd None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:59.125281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ea8a0a-058f-4b19-af53-b96171b561bd None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:59.130427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:59.131562 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.131840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.132114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.132747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:59.134687 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:59.160979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.225677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1227/2422] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 06:59:59 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:59.225922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:59.243130 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ba817-3a35-4172-8a64-81bc1241592b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:59.317032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.331046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:59.331747 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.332095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.332446 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.333096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:59.335061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:59.349279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.421123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1196/2423] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 06:59:59 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 06:59:59.427872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:59.439662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77732ef8-d645-4968-86a7-d612418ccf23 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:59.447775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:59.447775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.447775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.447775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.448351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:59.449976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:59.463470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1228/2424] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:59.466076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:59.486545 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a54bce-0814-4943-9ba1-f04ec4cff531 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:59.493611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d30cf7-6528-4694-b129-8df46af46ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:59.494316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d30cf7-6528-4694-b129-8df46af46ce1 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.495346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d30cf7-6528-4694-b129-8df46af46ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.495631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d30cf7-6528-4694-b129-8df46af46ce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.496358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d30cf7-6528-4694-b129-8df46af46ce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:59.498031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d30cf7-6528-4694-b129-8df46af46ce1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:59.512587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1197/2425] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 06:59:59 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 06:59:59.516649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:59.525461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.530275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282fd26-64d8-4b06-b9c7-998b59588022 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:59.541218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:59.542051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.542396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.542738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] PATH_INFO: `/v3/projects/f9db49859cfb436cbb49435e9d123048/users/018094c72d44499b8a900fc7d86c1986/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.550539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.562980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9db49859cfb436cbb49435e9d123048, user_id=018094c72d44499b8a900fc7d86c1986, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:59.566016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:59.625881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1229/2426] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 06:59:59 2022] PUT /identity/v3/projects/f9db49859cfb436cbb49435e9d123048/users/018094c72d44499b8a900fc7d86c1986/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 06:59:59.631315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4317781-b6a2-4e32-b3ee-a7d700922e32 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.631690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4317781-b6a2-4e32-b3ee-a7d700922e32 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.632051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4317781-b6a2-4e32-b3ee-a7d700922e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.660281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c4317781-b6a2-4e32-b3ee-a7d700922e32 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 06:59:59.661719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c4317781-b6a2-4e32-b3ee-a7d700922e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:59.734091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.751684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1198/2427] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 06:59:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 06:59:59.765684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 06:59:59.767881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 06:59:59.770094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 06:59:59.849384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f307c6-f293-4450-88e4-3b5bc2d2233d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 06:59:59.856124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 06:59:59.862069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 06:59:59.862069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 06:59:59.862069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 06:59:59.870426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 06:59:59.872111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 06:59:59.890247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1230/2428] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 06:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 06:59:59.945005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:00.059186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:00.384688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:00.481794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:00.648003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:02.005413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:02.212356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d555c-8723-43ab-b468-1c6f0d5f5cf6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:02.212831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d555c-8723-43ab-b468-1c6f0d5f5cf6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:02.212831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d555c-8723-43ab-b468-1c6f0d5f5cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:02.242948 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:02.270799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0d2d555c-8723-43ab-b468-1c6f0d5f5cf6 None None] MFA Rules not processed for user `018094c72d44499b8a900fc7d86c1986`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:02.272087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0d2d555c-8723-43ab-b468-1c6f0d5f5cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:02.408696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:02.443289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1199/2429] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:02.446600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:02.457478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad49c399-dda3-44ca-b8a5-b73e10d10333 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:02.462482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:02.463151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:02.463434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:02.463710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:02.464422 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:02.466368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:02.557705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1231/2430] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:00:02 2022] POST /identity/v3/projects => generated 371 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:00:02.563906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d555c-8723-43ab-b468-1c6f0d5f5cf6 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:02.575384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d555c-8723-43ab-b468-1c6f0d5f5cf6 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:02.650303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:02.651021 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:02.651304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:02.651691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:02.652339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:02.655458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:02.730406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:02.739613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1200/2431] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:00:02 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:00:02.741140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:02.758374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61652af-574d-4cd6-8012-3fd8307e4068 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:02.769397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:02.770244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:02.770670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:02.771087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:02.772394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:02.774242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:02.791341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1232/2432] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:00:02 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:00:02.792326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:02.805274 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9685b0e-44a6-4d87-acc0-12739a6f8e38 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:02.810670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:02.817720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:02.817720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:02.817720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] PATH_INFO: `/v3/projects/0152bf4a4a6a4091999bfd28531bdfe2/users/267d01190b8c441383885636ff9d9a81/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:02.831094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0152bf4a4a6a4091999bfd28531bdfe2, user_id=267d01190b8c441383885636ff9d9a81, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:02.836568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:03.026945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1201/2433] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:00:02 2022] PUT /identity/v3/projects/0152bf4a4a6a4091999bfd28531bdfe2/users/267d01190b8c441383885636ff9d9a81/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:00:03.027147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:03.038279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a364eea-f1ae-4e4a-bae2-e88296719614 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:03.142127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2906085c-02da-4ac8-bd72-5bba452820de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:03.144553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906085c-02da-4ac8-bd72-5bba452820de admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:03.145491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906085c-02da-4ac8-bd72-5bba452820de admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:03.145893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2906085c-02da-4ac8-bd72-5bba452820de admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:03.147250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906085c-02da-4ac8-bd72-5bba452820de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:03.149221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2906085c-02da-4ac8-bd72-5bba452820de admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:03.171300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1233/2434] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:00:03 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:00:03.174575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:03.198596 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f094a-083c-4ee5-a77d-64e7005d1475 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:03.212283 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebafd65-3610-46f7-acaf-2edcd8bd6316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:03.214487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebafd65-3610-46f7-acaf-2edcd8bd6316 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:03.215912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebafd65-3610-46f7-acaf-2edcd8bd6316 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:03.216457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebafd65-3610-46f7-acaf-2edcd8bd6316 admin admin] PATH_INFO: `/v3/projects/0152bf4a4a6a4091999bfd28531bdfe2/users/267d01190b8c441383885636ff9d9a81/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:03.220016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebafd65-3610-46f7-acaf-2edcd8bd6316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0152bf4a4a6a4091999bfd28531bdfe2, user_id=267d01190b8c441383885636ff9d9a81, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:03.223449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebafd65-3610-46f7-acaf-2edcd8bd6316 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:03.245216 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1202/2435] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:00:03 2022] PUT /identity/v3/projects/0152bf4a4a6a4091999bfd28531bdfe2/users/267d01190b8c441383885636ff9d9a81/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:00:03.260063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:04.534029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:05.162589 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:05.512912 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:05.513296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:05.513678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:05.579271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] MFA Rules not processed for user `267d01190b8c441383885636ff9d9a81`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:05.580817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:05.866892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1234/2436] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:05 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:05.873426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:05.879555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:05.879555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:05.907049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:05.933971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] MFA Rules not processed for user `018094c72d44499b8a900fc7d86c1986`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:05.965176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:05.965176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:06.008045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1203/2437] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:06.019893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:06.021872 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:06.132365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882a074-0d9b-42ba-90bf-5befef21f7c9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:06.138245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0425fac-f9c4-4c59-86c9-b3819a44ccce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:06.138914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0425fac-f9c4-4c59-86c9-b3819a44ccce service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:06.139204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0425fac-f9c4-4c59-86c9-b3819a44ccce service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:06.139456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0425fac-f9c4-4c59-86c9-b3819a44ccce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:06.147735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0425fac-f9c4-4c59-86c9-b3819a44ccce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:06.149363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0425fac-f9c4-4c59-86c9-b3819a44ccce service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:06.159752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1235/2438] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:00:07.642528 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:08.540175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:09.185806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:11.986344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:11.987698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:12.107362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c81908-df2f-417a-a730-0711fb964895 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:12.115005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:12.116025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:12.116484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:12.116983 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] PATH_INFO: `/v3/users/7466b4685b3749af8796f601bbfd4016` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:12.118359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7466b4685b3749af8796f601bbfd4016)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:12.120520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:12.391060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7466b4685b3749af8796f601bbfd4016'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:12.391808 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7466b4685b3749af8796f601bbfd4016'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:12.488792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7466b4685b3749af8796f601bbfd4016'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:12.512059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7466b4685b3749af8796f601bbfd4016'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:12.520203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7466b4685b3749af8796f601bbfd4016'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:12.528023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1204/2439] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:00:11 2022] DELETE /identity/v3/users/7466b4685b3749af8796f601bbfd4016 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:00:12.531178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:12.531690 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:12.531797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:12.554496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:12.555911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:12.635200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1236/2440] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:12.643656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:12.645205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:12.701441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:12.717161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2879a26c-167f-4b52-82f4-4fc2f32fc01e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:12.727716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835a8d3b-6716-4eb1-8f28-7d0db4304038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:12.728410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a8d3b-6716-4eb1-8f28-7d0db4304038 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:12.728720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a8d3b-6716-4eb1-8f28-7d0db4304038 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:12.728984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835a8d3b-6716-4eb1-8f28-7d0db4304038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:12.739433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a8d3b-6716-4eb1-8f28-7d0db4304038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:12.743098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835a8d3b-6716-4eb1-8f28-7d0db4304038 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:12.754624 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1205/2441] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:13.433587 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:13.437785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:13.462926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9350de0a-63ec-469a-a1a1-eb4eb0acd525 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:13.469097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:13.469952 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:13.471375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:13.471375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] PATH_INFO: `/v3/projects/6a8c36b6f96f42a0bcfcbf41866779ce` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:13.472045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a8c36b6f96f42a0bcfcbf41866779ce)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:13.476420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:13.479766 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:13.693029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a8c36b6f96f42a0bcfcbf41866779ce', 'request_id': 'req-f6fb7328-ef85-4eb8-a337-16d51245e412'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:13.701421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a8c36b6f96f42a0bcfcbf41866779ce', 'request_id': 'req-f6fb7328-ef85-4eb8-a337-16d51245e412'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:13.774907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a8c36b6f96f42a0bcfcbf41866779ce', 'request_id': 'req-f6fb7328-ef85-4eb8-a337-16d51245e412'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:13.795198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] The token cache is being invalidate because project 6a8c36b6f96f42a0bcfcbf41866779ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:00:13.795499 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:13.797447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6fb7328-ef85-4eb8-a337-16d51245e412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:13.800295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1237/2442] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:00:13 2022] DELETE /identity/v3/projects/6a8c36b6f96f42a0bcfcbf41866779ce => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:00:13.804831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce363d-ee70-4eb4-a2e3-9582de399161 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:13.805310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce363d-ee70-4eb4-a2e3-9582de399161 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:13.805389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ce363d-ee70-4eb4-a2e3-9582de399161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:13.826234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-73ce363d-ee70-4eb4-a2e3-9582de399161 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:13.827800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-73ce363d-ee70-4eb4-a2e3-9582de399161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:13.894881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1206/2443] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:13.902741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550acae-4c00-48b9-95d5-ecbf47e5f914 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:13.903074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550acae-4c00-48b9-95d5-ecbf47e5f914 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:13.903381 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c550acae-4c00-48b9-95d5-ecbf47e5f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:13.923607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c550acae-4c00-48b9-95d5-ecbf47e5f914 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:13.924835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c550acae-4c00-48b9-95d5-ecbf47e5f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:13.932921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1238/2444] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:13.938227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce363d-ee70-4eb4-a2e3-9582de399161 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:13.948555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ce363d-ee70-4eb4-a2e3-9582de399161 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:13.954527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:13.955388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:13.955678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:13.955995 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:13.956880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:00:13.957023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:13.958641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:13.971248 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1207/2445] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:00:13.976273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550acae-4c00-48b9-95d5-ecbf47e5f914 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:13.985961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c550acae-4c00-48b9-95d5-ecbf47e5f914 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:13.991092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be0047-bd89-417e-8458-59d7eb4ced57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:13.991713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be0047-bd89-417e-8458-59d7eb4ced57 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:13.991999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be0047-bd89-417e-8458-59d7eb4ced57 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:13.992277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be0047-bd89-417e-8458-59d7eb4ced57 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:13.992922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be0047-bd89-417e-8458-59d7eb4ced57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:13.994878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be0047-bd89-417e-8458-59d7eb4ced57 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:14.089508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1239/2446] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:00:13 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:00:14.093722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:14.108727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414f9-8812-4759-92f1-b4c6b68ffc08 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:14.178317 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:14.178971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.179247 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.179519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.180311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:14.182234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:14.228386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a9bb3-f5bb-43ed-97b8-84529a1d79d4 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.228684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a9bb3-f5bb-43ed-97b8-84529a1d79d4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.228969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20a9bb3-f5bb-43ed-97b8-84529a1d79d4 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.230368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1240/2447] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 07:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:00:14.235931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.236240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.236525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.256712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:14.257962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:14.345671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1208/2448] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:00:14 2022] POST /identity/v3/users => generated 295 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:00:14.345671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:14.351415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1241/2449] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 07:00:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:00:14.357782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d77fa4-b181-4d36-94d3-5dbb2b5d1800 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:14.362404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:14.363892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:14.364363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:14.365044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.365329 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.365640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.366257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:14.368820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:14.381737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1209/2450] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:00:14.386921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:14.398690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7736d9-ce8b-48e3-b9e3-ed483b866b9f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:14.404208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:14.404858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.405138 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.405413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.406621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:14.408284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:14.419316 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1210/2451] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:00:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:00:14.423807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:14.436882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed2b3e-13df-483e-a28f-fac221dc4763 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:14.442998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384cc229-1112-4114-998e-1fd5e1329d4a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:14.445495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:14.445495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.445495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.445495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] PATH_INFO: `/v3/projects/60f76ee7a2ab4aa7bdbe236e06b33390/users/540b386f43f2434696d3e7ed8632390e/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.448248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420f962c-0799-4f03-8981-15021ff3eb93 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:14.449208 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f962c-0799-4f03-8981-15021ff3eb93 service glance] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.449658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f962c-0799-4f03-8981-15021ff3eb93 service glance] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.450088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420f962c-0799-4f03-8981-15021ff3eb93 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.462600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f962c-0799-4f03-8981-15021ff3eb93 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:14.464302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420f962c-0799-4f03-8981-15021ff3eb93 service glance] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:14.467452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f76ee7a2ab4aa7bdbe236e06b33390, user_id=540b386f43f2434696d3e7ed8632390e, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:14.470905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:14.473977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:14.478601 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1242/2452] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:00:14.635304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1211/2453] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:00:14 2022] PUT /identity/v3/projects/60f76ee7a2ab4aa7bdbe236e06b33390/users/540b386f43f2434696d3e7ed8632390e/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:00:14.701322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738a41-5863-4f34-8a63-19312fa74832 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.701888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738a41-5863-4f34-8a63-19312fa74832 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.701888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e738a41-5863-4f34-8a63-19312fa74832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.748669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2e738a41-5863-4f34-8a63-19312fa74832 None None] MFA Rules not processed for user `540b386f43f2434696d3e7ed8632390e`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:14.749972 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2e738a41-5863-4f34-8a63-19312fa74832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:14.822927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1243/2454] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:14.842837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:14.842837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:14.854324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:14.873911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329fda1-1bd9-4981-ac43-102060a1dc1b None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.874272 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329fda1-1bd9-4981-ac43-102060a1dc1b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.874482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1329fda1-1bd9-4981-ac43-102060a1dc1b None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.876680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1244/2455] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 07:00:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:00:14.882183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19e8dc-b553-46a1-a7f4-b8823a16b0f2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.882909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19e8dc-b553-46a1-a7f4-b8823a16b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.888732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f19e8dc-b553-46a1-a7f4-b8823a16b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.907732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3f19e8dc-b553-46a1-a7f4-b8823a16b0f2 None None] MFA Rules not processed for user `60b49283ccd0414389601e5e6f339c45`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:14.911672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3f19e8dc-b553-46a1-a7f4-b8823a16b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:14.929733 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b976d3e-9368-4850-9bd0-0f4978d7c904 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:14.934685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:14.935706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:14.936402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:14.936783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:14.949000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:14.950700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:14.964618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1212/2456] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:14 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:14.993301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1245/2457] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 07:00:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:00:15.014005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:15.016019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:15.045553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e238f-c33d-4ee4-bb99-eb9f65cf37a7 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:15.057548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a425aac-c49f-495b-8d0c-77662eba63d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:15.058243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a425aac-c49f-495b-8d0c-77662eba63d9 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:15.058464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a425aac-c49f-495b-8d0c-77662eba63d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:15.058744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a425aac-c49f-495b-8d0c-77662eba63d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:15.067157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a425aac-c49f-495b-8d0c-77662eba63d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:15.068622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a425aac-c49f-495b-8d0c-77662eba63d9 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:15.078661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1213/2458] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:15.170030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1529-a7ae-4cca-a1cf-7113c8ea18b2 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:15.170318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1529-a7ae-4cca-a1cf-7113c8ea18b2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:15.170600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7c1529-a7ae-4cca-a1cf-7113c8ea18b2 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:15.172045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1246/2459] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 07:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:00:15.177324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3d511-d458-4cec-b214-1480ac8c3832 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:15.177616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3d511-d458-4cec-b214-1480ac8c3832 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:15.177898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d3d511-d458-4cec-b214-1480ac8c3832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:15.200067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a5d3d511-d458-4cec-b214-1480ac8c3832 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:15.202224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a5d3d511-d458-4cec-b214-1480ac8c3832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:15.294531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1214/2460] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 07:00:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:15.305411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1529-a7ae-4cca-a1cf-7113c8ea18b2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:15.318724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7c1529-a7ae-4cca-a1cf-7113c8ea18b2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:15.334463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:15.334463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:15.334463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:15.334463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:15.337278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:15.339189 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:15.352572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1247/2461] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:20.066743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7327e4-d530-455f-b9e1-4cf109aa7155 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:20.067259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7327e4-d530-455f-b9e1-4cf109aa7155 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:20.067473 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7327e4-d530-455f-b9e1-4cf109aa7155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:20.089190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-eb7327e4-d530-455f-b9e1-4cf109aa7155 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:20.089190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-eb7327e4-d530-455f-b9e1-4cf109aa7155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:20.149012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1215/2462] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 07:00:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:20.163128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:20.165610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:20.241885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f48cd73-7521-4595-ac87-beb2030d3b95 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:20.246943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d11a1-8fb6-4d43-ba80-3c7e3277abc2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:20.247545 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d11a1-8fb6-4d43-ba80-3c7e3277abc2 service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:20.247854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d11a1-8fb6-4d43-ba80-3c7e3277abc2 service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:20.248176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d11a1-8fb6-4d43-ba80-3c7e3277abc2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:20.257287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d11a1-8fb6-4d43-ba80-3c7e3277abc2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:20.258909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d11a1-8fb6-4d43-ba80-3c7e3277abc2 service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:20.268425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1248/2463] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:00:28.224819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7327e4-d530-455f-b9e1-4cf109aa7155 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:28.275638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:28.304166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7327e4-d530-455f-b9e1-4cf109aa7155 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:28.308972 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:28.309640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:28.309924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:28.310202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] PATH_INFO: `/v3/users/540b386f43f2434696d3e7ed8632390e` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:28.311625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=540b386f43f2434696d3e7ed8632390e)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:28.314334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:28.460468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '540b386f43f2434696d3e7ed8632390e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:28.461290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '540b386f43f2434696d3e7ed8632390e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:28.502230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '540b386f43f2434696d3e7ed8632390e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:28.516456 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '540b386f43f2434696d3e7ed8632390e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:28.526362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '540b386f43f2434696d3e7ed8632390e'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:28.536891 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1216/2464] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:00:28 2022] DELETE /identity/v3/users/540b386f43f2434696d3e7ed8632390e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:00:28.538538 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:28.539088 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:28.539199 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:28.561536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:28.562808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:28.571873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:28.627393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1249/2465] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:28.637235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:28.639008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:28.726701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4a3cd7-62e3-4f8c-b4c5-263b0a924618 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:28.730516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:28.731173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:28.731461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:28.731742 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:28.741935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:28.743415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:28.754848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1217/2466] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:29.132884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:29.134338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:29.152276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d7adc-d885-4e27-a211-517d85b2266a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:29.160844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:29.160844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:29.160844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:29.160844 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] PATH_INFO: `/v3/projects/60f76ee7a2ab4aa7bdbe236e06b33390` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:29.162349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f76ee7a2ab4aa7bdbe236e06b33390)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:29.164296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:29.241244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f76ee7a2ab4aa7bdbe236e06b33390', 'request_id': 'req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:29.247354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f76ee7a2ab4aa7bdbe236e06b33390', 'request_id': 'req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:29.291372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f76ee7a2ab4aa7bdbe236e06b33390', 'request_id': 'req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:29.305222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] The token cache is being invalidate because project 60f76ee7a2ab4aa7bdbe236e06b33390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:00:29.305513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:29.306198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-1d6c93e5-ffab-47b9-878e-b61c13ddb8a5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:29.307747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1250/2467] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:00:29 2022] DELETE /identity/v3/projects/60f76ee7a2ab4aa7bdbe236e06b33390 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:00:33.962272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:33.969190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:34.024920 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3883a-c68e-49ec-aa83-147972e63ca0 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:34.037606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:34.079754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f176ed-688f-4e5d-b125-aed7a0625d8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:34.081249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f176ed-688f-4e5d-b125-aed7a0625d8a service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:34.081539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f176ed-688f-4e5d-b125-aed7a0625d8a service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:34.081817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f176ed-688f-4e5d-b125-aed7a0625d8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:34.083754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-68f176ed-688f-4e5d-b125-aed7a0625d8a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:34.149039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f176ed-688f-4e5d-b125-aed7a0625d8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:34.150551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f176ed-688f-4e5d-b125-aed7a0625d8a service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:34.160784 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1218/2468] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:35.773137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:35.773678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:35.773678 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:35.793410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] MFA Rules not processed for user `559415f2e826476a8c677b2e6ef66d76`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:35.794627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:35.852581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1251/2469] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:00:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:40.133482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f59a-f81b-427c-8600-aa6058a0c5ee None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:40.133998 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f59a-f81b-427c-8600-aa6058a0c5ee None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:40.134207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d29f59a-f81b-427c-8600-aa6058a0c5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:40.155265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-4d29f59a-f81b-427c-8600-aa6058a0c5ee None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:40.156390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4d29f59a-f81b-427c-8600-aa6058a0c5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:40.213290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1219/2470] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 07:00:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:40.226094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:40.227543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:40.279705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:40.304136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f63330c-d421-4d60-921e-54faaf6f9b2a None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:40.309617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:40.310236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:40.310513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:40.310815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:40.319488 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:40.321249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:40.330401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1252/2471] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:00:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:00:50.207371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=67 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:50.355099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=13 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:55.574195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:55.574653 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:55.574802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:55.594620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:55.595907 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:55.604093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1220/2472] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 07:00:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:00:55.627882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:55.638462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4095e64a-13a0-4b5c-ab2b-f0808d816ca6 service swift] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:55.644063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c14cc-c5e3-4cd5-9f2b-bc267d216107 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:55.645245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c14cc-c5e3-4cd5-9f2b-bc267d216107 service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:55.645697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c14cc-c5e3-4cd5-9f2b-bc267d216107 service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:55.645970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c14cc-c5e3-4cd5-9f2b-bc267d216107 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:55.654978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c14cc-c5e3-4cd5-9f2b-bc267d216107 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:55.656649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c14cc-c5e3-4cd5-9f2b-bc267d216107 service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:55.666448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1253/2473] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:00:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 24 07:00:57.457960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:57.460699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:57.565814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ab0f9-4633-4950-8cfa-37a6a3cdcea7 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:57.572693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ce637-64bf-4e3d-aa99-76455c5f18fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:57.573741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ce637-64bf-4e3d-aa99-76455c5f18fe service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:57.574471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ce637-64bf-4e3d-aa99-76455c5f18fe service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:57.575161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ce637-64bf-4e3d-aa99-76455c5f18fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:57.578065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b83ce637-64bf-4e3d-aa99-76455c5f18fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:57.653097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ce637-64bf-4e3d-aa99-76455c5f18fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:57.653097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ce637-64bf-4e3d-aa99-76455c5f18fe service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:57.653097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1221/2474] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:57.653719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d387046-67e3-4f24-89bf-6d5460473624 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:57.653719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d387046-67e3-4f24-89bf-6d5460473624 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:57.653719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d387046-67e3-4f24-89bf-6d5460473624 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:57.653719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1254/2475] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 07:00:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:00:57.655687 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:57.656044 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:57.656337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:57.952661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] MFA Rules not processed for user `1c15217a015c4214b6769393fe48c1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:00:57.954874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:57.975506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1222/2476] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 07:00:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:00:57.990866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d387046-67e3-4f24-89bf-6d5460473624 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:57.994428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8d387046-67e3-4f24-89bf-6d5460473624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:58.064737 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d387046-67e3-4f24-89bf-6d5460473624 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:58.077216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:58.088513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:58.088513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:58.088513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:58.094145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:58.096988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:58.108945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1255/2477] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:00:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:00:58.812730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:58.821384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:00:58.913332 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56026ee6-b241-44fd-9b24-ea7ba5474d17 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:58.917863 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:58.918501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:58.918844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:58.919616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] PATH_INFO: `/v3/users/018094c72d44499b8a900fc7d86c1986` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:58.920518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018094c72d44499b8a900fc7d86c1986)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:58.922373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:59.146252 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018094c72d44499b8a900fc7d86c1986'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.146931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018094c72d44499b8a900fc7d86c1986'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.214692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018094c72d44499b8a900fc7d86c1986'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.231029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018094c72d44499b8a900fc7d86c1986'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.241202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:00:59.243481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018094c72d44499b8a900fc7d86c1986'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.251598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1223/2478] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:00:58 2022] DELETE /identity/v3/users/018094c72d44499b8a900fc7d86c1986 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:00:59.578473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:00:59.595430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd36c81-6e87-494b-b29a-c2afaf965035 service placement] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:00:59.716888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:00:59.717496 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:00:59.717790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:00:59.718067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] PATH_INFO: `/v3/projects/f9db49859cfb436cbb49435e9d123048` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:00:59.719331 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9db49859cfb436cbb49435e9d123048)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:00:59.721444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:00:59.882990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9db49859cfb436cbb49435e9d123048', 'request_id': 'req-06759b53-84bc-4f28-b308-d54ae4da401b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.892875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9db49859cfb436cbb49435e9d123048', 'request_id': 'req-06759b53-84bc-4f28-b308-d54ae4da401b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.964529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9db49859cfb436cbb49435e9d123048', 'request_id': 'req-06759b53-84bc-4f28-b308-d54ae4da401b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.991425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] The token cache is being invalidate because project f9db49859cfb436cbb49435e9d123048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:00:59.992180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.993444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:00:59.999348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1256/2479] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:00:59 2022] DELETE /identity/v3/projects/f9db49859cfb436cbb49435e9d123048 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:00.000378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:00.005116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:00.022118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09b762e-44f3-49ed-b6c8-5efe31665b59 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:00.114486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:00.115754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:00.116523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:00.117116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] PATH_INFO: `/v3/users/267d01190b8c441383885636ff9d9a81` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:00.119496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] RBAC: Authorizing `identity:delete_user(user_id=267d01190b8c441383885636ff9d9a81)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:00.123871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:00.341944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267d01190b8c441383885636ff9d9a81'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:00.342665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267d01190b8c441383885636ff9d9a81'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:00.415040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267d01190b8c441383885636ff9d9a81'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:00.434127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267d01190b8c441383885636ff9d9a81'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:00.442514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7a727bca-c980-4b80-a221-8d6368f4715f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267d01190b8c441383885636ff9d9a81'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:00.449360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1224/2480] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:00:59 2022] DELETE /identity/v3/users/267d01190b8c441383885636ff9d9a81 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:00.755431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:00.757462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:00.773267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06759b53-84bc-4f28-b308-d54ae4da401b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:00.849940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:00.850475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:00.850753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:00.851054 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] PATH_INFO: `/v3/projects/0152bf4a4a6a4091999bfd28531bdfe2` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:00.855531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0152bf4a4a6a4091999bfd28531bdfe2)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:00.857774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:00.866990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:01.024570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0152bf4a4a6a4091999bfd28531bdfe2', 'request_id': 'req-e861f599-638b-48d7-875a-f629c18d7db4'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:01.031405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0152bf4a4a6a4091999bfd28531bdfe2', 'request_id': 'req-e861f599-638b-48d7-875a-f629c18d7db4'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:01.150921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0152bf4a4a6a4091999bfd28531bdfe2', 'request_id': 'req-e861f599-638b-48d7-875a-f629c18d7db4'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:01.162299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] The token cache is being invalidate because project 0152bf4a4a6a4091999bfd28531bdfe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:01:01.162603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:01.163434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e861f599-638b-48d7-875a-f629c18d7db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:01.165090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1257/2481] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:01:00 2022] DELETE /identity/v3/projects/0152bf4a4a6a4091999bfd28531bdfe2 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:01.170832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b122-5bf5-4b17-9fef-f06f2c22f259 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.171439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b122-5bf5-4b17-9fef-f06f2c22f259 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.171592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a5b122-5bf5-4b17-9fef-f06f2c22f259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:01.197776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f9a5b122-5bf5-4b17-9fef-f06f2c22f259 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:01.199080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f9a5b122-5bf5-4b17-9fef-f06f2c22f259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:01.271772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1225/2482] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:01:01.280608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78059817-7d4b-4c03-8b5c-04060397f2f5 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.281136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78059817-7d4b-4c03-8b5c-04060397f2f5 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.281609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78059817-7d4b-4c03-8b5c-04060397f2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:01.303964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-78059817-7d4b-4c03-8b5c-04060397f2f5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:01.305343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-78059817-7d4b-4c03-8b5c-04060397f2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:01.318689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1258/2483] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:01:01.323668 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b122-5bf5-4b17-9fef-f06f2c22f259 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:01.340922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a5b122-5bf5-4b17-9fef-f06f2c22f259 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:01.347555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:01.348755 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.349732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.350041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:01.350718 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:01:01.351062 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:01.352785 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:01.366346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1226/2484] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:01:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:01:01.370937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78059817-7d4b-4c03-8b5c-04060397f2f5 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:01.381004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78059817-7d4b-4c03-8b5c-04060397f2f5 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:01.387066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:01.387723 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.388009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.388290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:01.388944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:01.390939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:01.663823 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1259/2485] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:01:01 2022] POST /identity/v3/projects => generated 375 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:01:01.668160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:01.673860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:01.683872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe54847-1477-477e-b6a0-a78d55b05b84 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:01.765939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:01.766570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.766902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.767164 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:01.767964 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:01.769917 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:01.871666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1227/2486] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:01:01 2022] POST /identity/v3/users => generated 288 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:01:01.872503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:01.887768 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3baee-c368-4de8-808b-5e0c831adaa0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:01.892774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:01.893993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.894292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.894576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:01.895471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:01.897907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:01.921376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1260/2487] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:01:01.926023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:01.936772 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5578f37b-a4df-4d6a-b41c-8e0ff99feacb admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:01.942140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b9f885-09c9-4f33-bf27-a987c9dbffa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:01.942800 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f885-09c9-4f33-bf27-a987c9dbffa1 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.943095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f885-09c9-4f33-bf27-a987c9dbffa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.943391 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b9f885-09c9-4f33-bf27-a987c9dbffa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:01.944042 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9f885-09c9-4f33-bf27-a987c9dbffa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:01.945715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b9f885-09c9-4f33-bf27-a987c9dbffa1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:01.956955 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1228/2488] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:01:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:01:01.961047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:01.971665 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61021cc3-2ede-417d-bc71-49430835b167 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:01.982614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:01.982614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:01.982614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:01.982614 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] PATH_INFO: `/v3/projects/1deafe42c51f4e5c9a5375bac43c19a9/users/2857cb8de1924af1b962b3c3da9aea77/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:02.004128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1deafe42c51f4e5c9a5375bac43c19a9, user_id=2857cb8de1924af1b962b3c3da9aea77, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:02.007050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:02.084042 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1261/2489] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:01:01 2022] PUT /identity/v3/projects/1deafe42c51f4e5c9a5375bac43c19a9/users/2857cb8de1924af1b962b3c3da9aea77/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:02.096415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503415-e432-484f-a4a3-d48bf9138240 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:02.097280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503415-e432-484f-a4a3-d48bf9138240 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:02.097280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45503415-e432-484f-a4a3-d48bf9138240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:02.132076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-45503415-e432-484f-a4a3-d48bf9138240 None None] MFA Rules not processed for user `2857cb8de1924af1b962b3c3da9aea77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:02.133358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-45503415-e432-484f-a4a3-d48bf9138240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:02.217635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1229/2490] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:02.230309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:02.232691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:02.315342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1648d9-0d8e-4f1b-a776-fc1992940723 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:02.321643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:02.322287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:02.322581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:02.322931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:02.335258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:02.336717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:02.358999 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1262/2491] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:01:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:01:12.213146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:12.342695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=75,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:13.425393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b9c49-295f-4057-9dba-81a28e30013d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:13.425880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b9c49-295f-4057-9dba-81a28e30013d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:13.426169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b9c49-295f-4057-9dba-81a28e30013d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:13.445643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0c9b9c49-295f-4057-9dba-81a28e30013d None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:13.446941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0c9b9c49-295f-4057-9dba-81a28e30013d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:13.509006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1230/2492] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 07:01:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:13.523002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:13.524427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:13.592809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b2640-b44a-4f98-add9-b92f8d9d27eb service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:13.597616 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e42569-a0f6-4a24-b1d1-a64046c3490b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:13.598222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42569-a0f6-4a24-b1d1-a64046c3490b service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:13.598503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42569-a0f6-4a24-b1d1-a64046c3490b service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:13.598799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42569-a0f6-4a24-b1d1-a64046c3490b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:13.607330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e42569-a0f6-4a24-b1d1-a64046c3490b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:13.608910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e42569-a0f6-4a24-b1d1-a64046c3490b service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:13.617214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1263/2493] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:01:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:01:14.976547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b9c49-295f-4057-9dba-81a28e30013d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:15.042481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b9c49-295f-4057-9dba-81a28e30013d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:15.048894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:15.053362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:15.053362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:15.053362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] PATH_INFO: `/v3/users/2857cb8de1924af1b962b3c3da9aea77` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:15.053362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2857cb8de1924af1b962b3c3da9aea77)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:15.053861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:15.276117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2857cb8de1924af1b962b3c3da9aea77'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:15.276799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2857cb8de1924af1b962b3c3da9aea77'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:15.376300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2857cb8de1924af1b962b3c3da9aea77'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:15.389683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2857cb8de1924af1b962b3c3da9aea77'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:15.397435 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2857cb8de1924af1b962b3c3da9aea77'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:15.403571 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1231/2494] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:01:14 2022] DELETE /identity/v3/users/2857cb8de1924af1b962b3c3da9aea77 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:15.408159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:15.408641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:15.408759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:15.428074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:15.429314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:15.488794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1264/2495] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:15.499139 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:15.500578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:15.530069 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:15.559900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734305c-b1dc-4431-8ba6-fccf954194d5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:15.563521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:15.564128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:15.564410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:15.564682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:15.573532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:15.575083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:15.585801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1232/2496] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:01:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:01:16.047111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:16.049046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:16.061867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a116b0a1-19cc-4636-bfe7-85bb072561ae None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:16.067104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:16.067770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:16.068539 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:16.070617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] PATH_INFO: `/v3/projects/1deafe42c51f4e5c9a5375bac43c19a9` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:16.070617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1deafe42c51f4e5c9a5375bac43c19a9)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:16.071998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:16.213067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1deafe42c51f4e5c9a5375bac43c19a9', 'request_id': 'req-35cf0d15-64a6-4e70-a110-5302533cb821'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:16.219241 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1deafe42c51f4e5c9a5375bac43c19a9', 'request_id': 'req-35cf0d15-64a6-4e70-a110-5302533cb821'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:16.303175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1deafe42c51f4e5c9a5375bac43c19a9', 'request_id': 'req-35cf0d15-64a6-4e70-a110-5302533cb821'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:16.319025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] The token cache is being invalidate because project 1deafe42c51f4e5c9a5375bac43c19a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:01:16.319329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:16.320053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:16.321852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1265/2497] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:01:16 2022] DELETE /identity/v3/projects/1deafe42c51f4e5c9a5375bac43c19a9 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:16.886466 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:16.895839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:16.901651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4bcfaaf-d98b-4535-811b-3d29a078c323 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:16.959436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:16.960079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:16.960366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:16.960651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] PATH_INFO: `/v3/users/559415f2e826476a8c677b2e6ef66d76` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:16.961806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=559415f2e826476a8c677b2e6ef66d76)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:16.963931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:17.218990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '559415f2e826476a8c677b2e6ef66d76'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.219580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '559415f2e826476a8c677b2e6ef66d76'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.319589 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '559415f2e826476a8c677b2e6ef66d76'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.332171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '559415f2e826476a8c677b2e6ef66d76'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.339206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a534f7f2-a12c-4067-a766-8023b7008a94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '559415f2e826476a8c677b2e6ef66d76'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.345199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1233/2498] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:01:16 2022] DELETE /identity/v3/users/559415f2e826476a8c677b2e6ef66d76 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:17.601264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:17.602724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:17.619152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cf0d15-64a6-4e70-a110-5302533cb821 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:17.630605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:17.679164 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:17.679814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:17.680099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:17.680383 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] PATH_INFO: `/v3/projects/194562bf98ce4f10b3747080f6869ff8` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:17.681581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194562bf98ce4f10b3747080f6869ff8)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:17.683544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:17.793551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194562bf98ce4f10b3747080f6869ff8', 'request_id': 'req-0de26774-0dc6-4984-a468-53adbde24718'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.799459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194562bf98ce4f10b3747080f6869ff8', 'request_id': 'req-0de26774-0dc6-4984-a468-53adbde24718'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.907596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194562bf98ce4f10b3747080f6869ff8', 'request_id': 'req-0de26774-0dc6-4984-a468-53adbde24718'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.921001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] The token cache is being invalidate because project 194562bf98ce4f10b3747080f6869ff8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:01:17.921297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.922225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-0de26774-0dc6-4984-a468-53adbde24718 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:17.923754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1266/2499] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:01:17 2022] DELETE /identity/v3/projects/194562bf98ce4f10b3747080f6869ff8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:17.928775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea40c-d80c-4257-a085-445b2c409881 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:17.929258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea40c-d80c-4257-a085-445b2c409881 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:17.929395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503ea40c-d80c-4257-a085-445b2c409881 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:17.948757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-503ea40c-d80c-4257-a085-445b2c409881 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:17.949976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-503ea40c-d80c-4257-a085-445b2c409881 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:17.992508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:18.009237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1234/2500] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:18.017353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db3b44-59e3-4b35-ac6a-0344ddc1e214 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.017644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db3b44-59e3-4b35-ac6a-0344ddc1e214 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.017931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78db3b44-59e3-4b35-ac6a-0344ddc1e214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.038547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-78db3b44-59e3-4b35-ac6a-0344ddc1e214 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:18.039938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-78db3b44-59e3-4b35-ac6a-0344ddc1e214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:18.048427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1267/2501] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:18.052696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ea40c-d80c-4257-a085-445b2c409881 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:18.062141 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503ea40c-d80c-4257-a085-445b2c409881 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:18.066736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:18.067362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.067641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.067915 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.068559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:01:18.068861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:18.070477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:18.082263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1235/2502] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:01:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:01:18.087051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db3b44-59e3-4b35-ac6a-0344ddc1e214 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:18.096330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78db3b44-59e3-4b35-ac6a-0344ddc1e214 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:18.101619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:18.102215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.102502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.102825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.103463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:18.105395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:18.219130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1268/2503] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:01:18 2022] POST /identity/v3/projects => generated 367 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:01:18.223789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:18.234620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c0192-b43d-4663-bf9e-201746d6672b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:18.301988 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:18.302508 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.302809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.303090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.303734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:18.305670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:18.434578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1236/2504] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:01:18 2022] POST /identity/v3/users => generated 284 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:01:18.438944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:18.450406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df36cbb-4c6d-4915-99db-5d75914594f2 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:18.455576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:18.457522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.457522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.457522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.457522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:18.460998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:18.470777 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1269/2505] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:01:18.475140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:18.485608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be9929d-40ad-467f-9790-fc9fd425782f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:18.490373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcab6e5-7e65-45b6-b687-bf79b1fb916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:18.491027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab6e5-7e65-45b6-b687-bf79b1fb916f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.491314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab6e5-7e65-45b6-b687-bf79b1fb916f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.491595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab6e5-7e65-45b6-b687-bf79b1fb916f admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.492246 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcab6e5-7e65-45b6-b687-bf79b1fb916f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:18.493885 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcab6e5-7e65-45b6-b687-bf79b1fb916f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:18.504753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1237/2506] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:01:18.509586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:18.520082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bc5205-1c83-45a4-827d-739f9492ac21 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:18.525636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:18.526309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.526596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.526920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] PATH_INFO: `/v3/projects/760583d79d354adbaf50cc052cc2076f/users/d271c91ae7d14b5f95bd8543e3f6bd93/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.543856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] RBAC: Authorizing `identity:create_grant(project_id=760583d79d354adbaf50cc052cc2076f, user_id=d271c91ae7d14b5f95bd8543e3f6bd93, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:18.546815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:18.628706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1270/2507] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:01:18 2022] PUT /identity/v3/projects/760583d79d354adbaf50cc052cc2076f/users/d271c91ae7d14b5f95bd8543e3f6bd93/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:18.646207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf91ea0-0d6b-4ec6-8cc8-8157249db6ce None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.646520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf91ea0-0d6b-4ec6-8cc8-8157249db6ce None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.646841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf91ea0-0d6b-4ec6-8cc8-8157249db6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.676919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-acf91ea0-0d6b-4ec6-8cc8-8157249db6ce None None] MFA Rules not processed for user `d271c91ae7d14b5f95bd8543e3f6bd93`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:18.678654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-acf91ea0-0d6b-4ec6-8cc8-8157249db6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:18.744099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1238/2508] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:18.755739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:18.758109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:18.806443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:18.821666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b9f713-7915-42c9-8b2e-2570a3b0c08e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:18.825471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:18.826086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:18.826376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:18.826651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:18.836682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:18.838259 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:18.848137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1271/2509] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:01:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:01:28.879638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=78,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:28.919765 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=8 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:32.776146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad789c-586c-4ca5-92b2-873a187bc0a7 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:32.776702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad789c-586c-4ca5-92b2-873a187bc0a7 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:32.776702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad789c-586c-4ca5-92b2-873a187bc0a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:32.795202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a7ad789c-586c-4ca5-92b2-873a187bc0a7 None None] MFA Rules not processed for user `024eb38f66684644b1d0b38b3f297ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:32.796437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a7ad789c-586c-4ca5-92b2-873a187bc0a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:32.850779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1239/2510] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:42.844144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=25 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:43.743096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:43.804645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6cbae-6b61-4f08-a1a1-5caf37e3ba25 service glance] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:43.809176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:43.809800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:43.810085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:43.810365 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] PATH_INFO: `/v3/users/d271c91ae7d14b5f95bd8543e3f6bd93` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:43.811518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d271c91ae7d14b5f95bd8543e3f6bd93)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:43.813437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:44.094885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd271c91ae7d14b5f95bd8543e3f6bd93'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:44.096074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd271c91ae7d14b5f95bd8543e3f6bd93'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:44.190903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd271c91ae7d14b5f95bd8543e3f6bd93'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:44.200470 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd271c91ae7d14b5f95bd8543e3f6bd93'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:44.213704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd271c91ae7d14b5f95bd8543e3f6bd93'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:44.220486 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1272/2511] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:01:43 2022] DELETE /identity/v3/users/d271c91ae7d14b5f95bd8543e3f6bd93 => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:01:44.225228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:44.225888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:44.225888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:44.247198 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:44.248504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:44.321730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1240/2512] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:44.332370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:44.333901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:44.401933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2318f085-c49a-444c-9a8d-7de4527f2cf8 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:44.405630 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d17986-5451-4cd7-a1e1-7d69a444f8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:44.406242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d17986-5451-4cd7-a1e1-7d69a444f8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:44.406522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d17986-5451-4cd7-a1e1-7d69a444f8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:44.408294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d17986-5451-4cd7-a1e1-7d69a444f8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:44.421246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d17986-5451-4cd7-a1e1-7d69a444f8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:44.421246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d17986-5451-4cd7-a1e1-7d69a444f8c6 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:44.431475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1273/2513] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:01:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:01:45.467629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:45.469228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:45.484481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7fd209-bc8a-4ef4-9120-0e3302f9920c None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:45.490590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:45.491284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:45.491642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:45.491883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] PATH_INFO: `/v3/projects/760583d79d354adbaf50cc052cc2076f` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:45.493149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760583d79d354adbaf50cc052cc2076f)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:45.495149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:45.668838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760583d79d354adbaf50cc052cc2076f', 'request_id': 'req-aae5880c-7255-46db-9737-796ccfa8c9c2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:45.675912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760583d79d354adbaf50cc052cc2076f', 'request_id': 'req-aae5880c-7255-46db-9737-796ccfa8c9c2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:45.682375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760583d79d354adbaf50cc052cc2076f', 'request_id': 'req-aae5880c-7255-46db-9737-796ccfa8c9c2'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:45.778334 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] The token cache is being invalidate because project 760583d79d354adbaf50cc052cc2076f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:01:45.778637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:45.779293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-aae5880c-7255-46db-9737-796ccfa8c9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:01:45.780788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1241/2514] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:01:45 2022] DELETE /identity/v3/projects/760583d79d354adbaf50cc052cc2076f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:45.785650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6f73-976c-46d9-86f5-52743d5b3962 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:45.786106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6f73-976c-46d9-86f5-52743d5b3962 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:45.786230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ff6f73-976c-46d9-86f5-52743d5b3962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:45.806294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-37ff6f73-976c-46d9-86f5-52743d5b3962 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:45.807541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-37ff6f73-976c-46d9-86f5-52743d5b3962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:45.824869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:45.866286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1274/2515] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:45.874297 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976e0c-e2ac-4527-8653-1295e6e56110 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:45.874597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976e0c-e2ac-4527-8653-1295e6e56110 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:45.874930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4976e0c-e2ac-4527-8653-1295e6e56110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:45.895043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b4976e0c-e2ac-4527-8653-1295e6e56110 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:45.896266 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b4976e0c-e2ac-4527-8653-1295e6e56110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:45.904308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1242/2516] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:45.908546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6f73-976c-46d9-86f5-52743d5b3962 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:45.919448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ff6f73-976c-46d9-86f5-52743d5b3962 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:45.924006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:45.924605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:45.925160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:45.927359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:45.927359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:01:45.927359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:45.928185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:45.940825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1275/2517] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:01:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:01:45.945239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4976e0c-e2ac-4527-8653-1295e6e56110 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:45.954825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4976e0c-e2ac-4527-8653-1295e6e56110 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:45.959514 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:45.960147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:45.960436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:45.960716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:45.961347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:45.963292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:46.044005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1243/2518] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:01:45 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:01:46.048194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:46.059456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111d6c5e-004d-44e9-b079-18f71688716e admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:46.115633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:46.116243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:46.116526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:46.116806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:46.118070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:46.120024 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:46.237256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1276/2519] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:01:46 2022] POST /identity/v3/users => generated 292 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:01:46.241304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:46.252303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49367a04-c23f-4f5a-929f-5a8f753d8aee admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:46.257375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:46.258023 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:46.258306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:46.258581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:46.259257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:46.260851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:46.271054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1244/2520] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:01:46.274880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:46.284833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea92e3-86b5-4771-998f-4baef7ee9cef admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:46.290044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bafdfae-fe46-4297-b8f9-8158cb51bd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:46.290651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafdfae-fe46-4297-b8f9-8158cb51bd1d admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:46.290964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafdfae-fe46-4297-b8f9-8158cb51bd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:46.291243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bafdfae-fe46-4297-b8f9-8158cb51bd1d admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:46.291889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafdfae-fe46-4297-b8f9-8158cb51bd1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:46.293489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bafdfae-fe46-4297-b8f9-8158cb51bd1d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:46.306043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1277/2521] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:01:46.310260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:46.320761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9498f6b8-02f3-4cab-b141-e68bdcdc29c4 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:46.325540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:46.326209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:46.326490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:46.326802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] PATH_INFO: `/v3/projects/45fd13e3fd8f43e8a47a75b16fdc08e0/users/6e845e38f3984215be78abf353cad81a/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:46.348189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45fd13e3fd8f43e8a47a75b16fdc08e0, user_id=6e845e38f3984215be78abf353cad81a, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:46.350802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:46.428005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1245/2522] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:01:46 2022] PUT /identity/v3/projects/45fd13e3fd8f43e8a47a75b16fdc08e0/users/6e845e38f3984215be78abf353cad81a/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:01:46.433286 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e65f-9ca8-48f5-9ca9-82ba4e2a0368 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:46.433668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e65f-9ca8-48f5-9ca9-82ba4e2a0368 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:46.434051 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2e65f-9ca8-48f5-9ca9-82ba4e2a0368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:46.457085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-b1c2e65f-9ca8-48f5-9ca9-82ba4e2a0368 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:46.458702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b1c2e65f-9ca8-48f5-9ca9-82ba4e2a0368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:46.535128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1278/2523] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:01:46.544696 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:46.546552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:46.574045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:46.608647 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2d2fac-2196-4e6b-aaad-6cc6ae861b93 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:46.612516 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:46.613190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:46.613475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:46.613752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:46.623857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:46.625307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:46.636104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1246/2524] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:01:48.842240 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7454974-81cf-4923-8d86-b42a92713c0b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:48.842673 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7454974-81cf-4923-8d86-b42a92713c0b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:48.843015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7454974-81cf-4923-8d86-b42a92713c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:48.877821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a7454974-81cf-4923-8d86-b42a92713c0b None None] MFA Rules not processed for user `6e845e38f3984215be78abf353cad81a`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:48.879285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a7454974-81cf-4923-8d86-b42a92713c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:48.913474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:01:48.965826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1279/2525] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:01:48.978676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:01:48.980273 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:49.043355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd59d19-7c01-4917-a446-8b54101c8c38 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:01:49.047127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c14209-8cb7-4f07-bbb1-8262e5b0f318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:01:49.047748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14209-8cb7-4f07-bbb1-8262e5b0f318 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:49.048039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14209-8cb7-4f07-bbb1-8262e5b0f318 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:49.048321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c14209-8cb7-4f07-bbb1-8262e5b0f318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:49.060170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c14209-8cb7-4f07-bbb1-8262e5b0f318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:01:49.062707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c14209-8cb7-4f07-bbb1-8262e5b0f318 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:01:49.071680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1247/2526] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:01:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:01:50.313919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547e149-296c-4e04-b52a-fb2cda3d7d93 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:50.314554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547e149-296c-4e04-b52a-fb2cda3d7d93 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:50.314554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547e149-296c-4e04-b52a-fb2cda3d7d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:50.464791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d547e149-296c-4e04-b52a-fb2cda3d7d93 None None] MFA Rules not processed for user `6a91e857dd3b4c1f9355b757cadd6bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:50.466029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d547e149-296c-4e04-b52a-fb2cda3d7d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:50.526884 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1280/2527] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:01:51.030671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:01:51.031690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:01:51.031690 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:01:51.055103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] MFA Rules not processed for user `6e845e38f3984215be78abf353cad81a`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:01:51.056338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:01:51.064037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1248/2528] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:01:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:02:00.519842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=44 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:01.046263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=46 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:24.199688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b8b23-de7a-4acc-af86-512997bae335 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:24.200368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b8b23-de7a-4acc-af86-512997bae335 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:24.200368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b8b23-de7a-4acc-af86-512997bae335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:24.220712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-329b8b23-de7a-4acc-af86-512997bae335 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:02:24.221946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-329b8b23-de7a-4acc-af86-512997bae335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:24.230853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1281/2529] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:02:24.250919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:24.252455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:24.328358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068568e1-c605-4221-b7ff-c3814360b978 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:24.333782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:24.334396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:24.334683 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:24.334990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:24.343563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:24.345167 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:24.355630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1249/2530] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:02:28.695829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f5d8-cd4c-4801-b361-fda1131f039b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:28.696567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f5d8-cd4c-4801-b361-fda1131f039b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:28.696567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a2f5d8-cd4c-4801-b361-fda1131f039b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:28.729790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-20a2f5d8-cd4c-4801-b361-fda1131f039b None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:02:28.729790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-20a2f5d8-cd4c-4801-b361-fda1131f039b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:28.729790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1282/2531] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:02:28.742109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:28.743870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:28.760542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c1d564-00ae-4abe-a4f3-db309ca0dcf6 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:28.767330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:28.781405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:28.781405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:28.781405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:28.781405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:28.781405 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:28.789872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1250/2532] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:02:33.120573 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eaaa9-dd6f-4138-8829-e74396d806c1 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:33.121166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eaaa9-dd6f-4138-8829-e74396d806c1 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:33.121166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2eaaa9-dd6f-4138-8829-e74396d806c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:33.141156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4a2eaaa9-dd6f-4138-8829-e74396d806c1 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:02:33.142264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4a2eaaa9-dd6f-4138-8829-e74396d806c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:33.150193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1283/2533] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:02:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:02:33.166914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:33.178961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd481bce-4a75-4eb0-aefd-6575e653ec89 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:33.185088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:33.185619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:33.185901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:33.187104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:33.196443 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:33.198638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:33.208518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1251/2534] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:02:35.993541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce4284-7cbc-4ff0-8ecb-4bb2d85c2f18 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:36.000135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce4284-7cbc-4ff0-8ecb-4bb2d85c2f18 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:36.000135 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce4284-7cbc-4ff0-8ecb-4bb2d85c2f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:36.013605 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-85ce4284-7cbc-4ff0-8ecb-4bb2d85c2f18 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:02:36.014725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-85ce4284-7cbc-4ff0-8ecb-4bb2d85c2f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:36.022695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1284/2535] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:02:36.037485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:36.049179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84448a5f-5c49-4380-b734-8f0f47d12681 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:36.055196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:36.055823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:36.056105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:36.056382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:36.065745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:36.067392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:36.079205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1252/2536] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:02:40.310167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec0ac-dcb0-4b61-9840-385c2137e1be None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:40.310742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec0ac-dcb0-4b61-9840-385c2137e1be None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:40.310742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdec0ac-dcb0-4b61-9840-385c2137e1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:40.331147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2fdec0ac-dcb0-4b61-9840-385c2137e1be None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:02:40.332304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2fdec0ac-dcb0-4b61-9840-385c2137e1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:40.340939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1285/2537] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:02:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:02:40.357099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:40.368472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c031917-e6de-45fc-84c6-8eed4057acd2 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:40.374124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:40.374734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:40.375063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:40.375341 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:40.384073 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:40.385714 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:40.396004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1253/2538] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:02:45.620717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d977-4caf-47a6-ba6b-e37d98b71629 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:45.621186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d977-4caf-47a6-ba6b-e37d98b71629 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:45.621299 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9d977-4caf-47a6-ba6b-e37d98b71629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:45.640420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-cbb9d977-4caf-47a6-ba6b-e37d98b71629 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:02:45.641559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-cbb9d977-4caf-47a6-ba6b-e37d98b71629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:45.649412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1286/2539] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:02:45.676699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:45.689165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68462c-3272-415c-9a4d-8e89d437dd87 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:45.694906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423881ff-75fc-4c84-b604-60a00f4f56e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:45.695519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423881ff-75fc-4c84-b604-60a00f4f56e8 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:45.695801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423881ff-75fc-4c84-b604-60a00f4f56e8 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:45.696077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423881ff-75fc-4c84-b604-60a00f4f56e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:45.705512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423881ff-75fc-4c84-b604-60a00f4f56e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:45.707129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423881ff-75fc-4c84-b604-60a00f4f56e8 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:45.717143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1254/2540] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:02:51.106982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d977-4caf-47a6-ba6b-e37d98b71629 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:51.111809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=19 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:51.117502 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9d977-4caf-47a6-ba6b-e37d98b71629 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:51.121715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:51.122608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:51.123219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:51.123848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:51.126180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:51.142031 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:51.143541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:51.157418 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1287/2541] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:02:51.427026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbf603-3d6c-47da-9791-363e4c67b6dd None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:51.427523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbf603-3d6c-47da-9791-363e4c67b6dd None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:51.427639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccbf603-3d6c-47da-9791-363e4c67b6dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:51.436123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=65 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:02:51.448402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7ccbf603-3d6c-47da-9791-363e4c67b6dd None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:02:51.449641 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7ccbf603-3d6c-47da-9791-363e4c67b6dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:51.508521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1255/2542] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 07:02:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:02:51.714098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:51.716126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:51.800764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae899540-7272-450d-b457-cc49a9a476d4 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:51.806480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:51.807577 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:51.808642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:51.809099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:51.820172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:51.821764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:51.831336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1288/2543] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:02:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:02:52.513958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbf603-3d6c-47da-9791-363e4c67b6dd None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:02:52.524669 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccbf603-3d6c-47da-9791-363e4c67b6dd None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:02:52.530991 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:02:52.532737 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:02:52.534093 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:02:52.537213 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:02:52.549982 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:02:52.584834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:02:52.586449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:02:52.613767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1256/2544] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:02:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:01.827652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=37 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:02.602125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=30 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:05.993898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:06.003683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8602b9dc-a89c-4440-a274-bd7634897adc service swift] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:06.007281 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cadfe6-cc7d-462e-b37f-aee86fba4dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:06.007861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cadfe6-cc7d-462e-b37f-aee86fba4dda service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:06.008137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cadfe6-cc7d-462e-b37f-aee86fba4dda service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:06.008405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cadfe6-cc7d-462e-b37f-aee86fba4dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:06.010295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c9cadfe6-cc7d-462e-b37f-aee86fba4dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:06.071917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cadfe6-cc7d-462e-b37f-aee86fba4dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:06.073359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cadfe6-cc7d-462e-b37f-aee86fba4dda service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:06.083784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1289/2545] 10.222.0.59 () {60 vars in 1396 bytes} [Wed Aug 24 07:03:05 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:08.300791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:08.312848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7cc4f2-ade8-4065-afcd-b5b6c3f7b772 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:08.318592 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:08.319136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:08.319452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:08.319725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:08.321460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:08.332532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:08.334154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:08.344583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1257/2546] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:08 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:10.269147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:10.269704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:10.269704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:10.289132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] MFA Rules not processed for user `6e845e38f3984215be78abf353cad81a`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:10.290341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:10.297513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1290/2547] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:03:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:03:10.545250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:10.556147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3ca9e-0236-4930-bcf9-404c35a4685a service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:10.561377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb07e-19cf-488f-ae29-d4f3f50bbad1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:10.562313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb07e-19cf-488f-ae29-d4f3f50bbad1 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:10.562640 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb07e-19cf-488f-ae29-d4f3f50bbad1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:10.563370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb07e-19cf-488f-ae29-d4f3f50bbad1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:10.565810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-01adb07e-19cf-488f-ae29-d4f3f50bbad1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:10.587219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adb07e-19cf-488f-ae29-d4f3f50bbad1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:10.588697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adb07e-19cf-488f-ae29-d4f3f50bbad1 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:10.598270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1258/2548] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:11.766158 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:11.767891 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:11.780960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b15b396-02d8-480b-98d8-ca18fe95b4ab None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:11.784889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ab78c7-a4f1-4364-961e-2350a1468717 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:11.785567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab78c7-a4f1-4364-961e-2350a1468717 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:11.785783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab78c7-a4f1-4364-961e-2350a1468717 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:11.786061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ab78c7-a4f1-4364-961e-2350a1468717 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:11.787868 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d0ab78c7-a4f1-4364-961e-2350a1468717 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:11.801120 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab78c7-a4f1-4364-961e-2350a1468717 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:11.802586 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ab78c7-a4f1-4364-961e-2350a1468717 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:11.813446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1291/2549] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:14.950295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961500-856e-4b51-a4c6-e9b269791264 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:14.952010 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961500-856e-4b51-a4c6-e9b269791264 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:14.952411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47961500-856e-4b51-a4c6-e9b269791264 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:14.953985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1259/2550] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 07:03:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:03:14.961188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1517-f25a-4f4b-9d55-245c4f5fbbc9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:14.961752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1517-f25a-4f4b-9d55-245c4f5fbbc9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:14.961853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af1517-f25a-4f4b-9d55-245c4f5fbbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:15.009498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c4af1517-f25a-4f4b-9d55-245c4f5fbbc9 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:15.013477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c4af1517-f25a-4f4b-9d55-245c4f5fbbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:15.033215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1292/2551] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 07:03:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:15.047590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47961500-856e-4b51-a4c6-e9b269791264 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:15.055620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-47961500-856e-4b51-a4c6-e9b269791264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:15.190345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47961500-856e-4b51-a4c6-e9b269791264 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:15.195459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bacbfd-4aae-4af3-bf12-77880d263f39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:15.196149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bacbfd-4aae-4af3-bf12-77880d263f39 service glance] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:15.196433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bacbfd-4aae-4af3-bf12-77880d263f39 service glance] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:15.196705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bacbfd-4aae-4af3-bf12-77880d263f39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:15.214465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bacbfd-4aae-4af3-bf12-77880d263f39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:15.218124 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bacbfd-4aae-4af3-bf12-77880d263f39 service glance] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:15.237656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1260/2552] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:03:15.614638 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1458-809b-48b9-8f62-b4568fa58c48 None None] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:15.615503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1458-809b-48b9-8f62-b4568fa58c48 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:15.615993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dd1458-809b-48b9-8f62-b4568fa58c48 None None] PATH_INFO: `/` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:15.619861 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1293/2553] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 07:03:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 24 07:03:15.626146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747c14-f8ae-4667-b37a-e525b71bc806 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:15.626439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747c14-f8ae-4667-b37a-e525b71bc806 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:15.626946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a747c14-f8ae-4667-b37a-e525b71bc806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:15.672643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-4a747c14-f8ae-4667-b37a-e525b71bc806 None None] MFA Rules not processed for user `60b49283ccd0414389601e5e6f339c45`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:15.674228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4a747c14-f8ae-4667-b37a-e525b71bc806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:15.685526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1261/2554] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 07:03:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:15.719523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1458-809b-48b9-8f62-b4568fa58c48 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:15.758456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dd1458-809b-48b9-8f62-b4568fa58c48 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:15.766664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ef20b-15d4-4ccb-bd54-c1128e530515 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:15.767804 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef20b-15d4-4ccb-bd54-c1128e530515 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:15.768593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef20b-15d4-4ccb-bd54-c1128e530515 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:15.769077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ef20b-15d4-4ccb-bd54-c1128e530515 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:15.790239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef20b-15d4-4ccb-bd54-c1128e530515 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:15.792635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ef20b-15d4-4ccb-bd54-c1128e530515 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:15.804443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1294/2555] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:15.945096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1166-cdca-4d43-879d-9f3e6deceaf9 None None] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:15.945458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1166-cdca-4d43-879d-9f3e6deceaf9 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:15.946173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fff1166-cdca-4d43-879d-9f3e6deceaf9 None None] PATH_INFO: `/` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:15.947850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1262/2556] 10.222.0.59 () {54 vars in 921 bytes} [Wed Aug 24 07:03:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 24 07:03:15.954491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:15.954947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:15.955229 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:15.977376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] MFA Rules not processed for user `2a68d368b5d14b75aaba3bbb3f4bb62c`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:15.978871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:16.011406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1295/2557] 10.222.0.59 () {58 vars in 1018 bytes} [Wed Aug 24 07:03:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:16.011539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff1166-cdca-4d43-879d-9f3e6deceaf9 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:16.018504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fff1166-cdca-4d43-879d-9f3e6deceaf9 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:16.031997 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:16.034115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:16.034115 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:16.034474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:16.055960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:16.059563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:16.075970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1263/2558] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:16.228006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:16.229940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:16.327738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa6a34e-cf5c-47a3-846d-c6e7f101cb08 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:16.338427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:16.338427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:16.338427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:16.338427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:16.344446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:16.357425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:16.359169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:16.374700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1296/2559] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:16.583368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:16.585163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:16.602460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cdcdd8-30f7-4230-beb4-afcb3d8ba825 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:16.607608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:16.608249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:16.608534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:16.609001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] PATH_INFO: `/v3/users/6a91e857dd3b4c1f9355b757cadd6bd0` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:16.610436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a91e857dd3b4c1f9355b757cadd6bd0)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:16.612764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:16.940901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a91e857dd3b4c1f9355b757cadd6bd0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:16.941637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a91e857dd3b4c1f9355b757cadd6bd0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:17.197635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a91e857dd3b4c1f9355b757cadd6bd0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:17.220658 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a91e857dd3b4c1f9355b757cadd6bd0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:17.229636 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-b002913f-7dc1-4974-bc54-572c2a439912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a91e857dd3b4c1f9355b757cadd6bd0'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:17.237001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1264/2560] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:03:16 2022] DELETE /identity/v3/users/6a91e857dd3b4c1f9355b757cadd6bd0 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:03:17.663697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:17.680510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aba385c-3a12-4a3c-91dd-5d13868a3f99 service placement] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:17.725960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:17.743432 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:17.744085 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:17.744370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:17.744667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] PATH_INFO: `/v3/projects/441ca39174f9445d920c45963e827f20` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:17.745827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] RBAC: Authorizing `identity:delete_project(project_id=441ca39174f9445d920c45963e827f20)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:17.748359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:17.894926 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441ca39174f9445d920c45963e827f20', 'request_id': 'req-f30a5639-659f-4e94-b8cb-b5c74b608934'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:17.900928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441ca39174f9445d920c45963e827f20', 'request_id': 'req-f30a5639-659f-4e94-b8cb-b5c74b608934'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:18.036901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441ca39174f9445d920c45963e827f20', 'request_id': 'req-f30a5639-659f-4e94-b8cb-b5c74b608934'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:18.048806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] The token cache is being invalidate because project 441ca39174f9445d920c45963e827f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:03:18.049098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:18.049735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f30a5639-659f-4e94-b8cb-b5c74b608934 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:03:18.051268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1297/2561] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:03:17 2022] DELETE /identity/v3/projects/441ca39174f9445d920c45963e827f20 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:03:18.057295 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280f34-df32-479a-a373-72be8787cab3 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.057581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280f34-df32-479a-a373-72be8787cab3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.057855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d280f34-df32-479a-a373-72be8787cab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.080245 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-2d280f34-df32-479a-a373-72be8787cab3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:18.081497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2d280f34-df32-479a-a373-72be8787cab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:18.106004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:18.143626 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1265/2562] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:18.151742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730e131-8042-4c72-b4a7-565a62cf3f6e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.152032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730e131-8042-4c72-b4a7-565a62cf3f6e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.152355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8730e131-8042-4c72-b4a7-565a62cf3f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.172436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-8730e131-8042-4c72-b4a7-565a62cf3f6e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:18.173684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8730e131-8042-4c72-b4a7-565a62cf3f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:18.184558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1298/2563] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:03:18.188798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280f34-df32-479a-a373-72be8787cab3 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:18.198897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d280f34-df32-479a-a373-72be8787cab3 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:18.204372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:18.206312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.206312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.206312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.206868 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:03:18.207128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:18.208763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:18.221837 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1266/2564] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:03:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:03:18.226214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730e131-8042-4c72-b4a7-565a62cf3f6e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:18.236444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8730e131-8042-4c72-b4a7-565a62cf3f6e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:18.241388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:18.241997 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.242277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.242549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.243244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:18.245123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:18.403922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1299/2565] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:03:18 2022] POST /identity/v3/projects => generated 383 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:03:18.408157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:18.419134 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aa0420-4848-446e-a9a4-ecadf2eefb66 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:18.478583 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:18.479236 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.479716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.480025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.481992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:18.484083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:18.655288 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1267/2566] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:03:18 2022] POST /identity/v3/users => generated 292 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:03:18.659356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:18.671914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d1d2d-8ea7-4fe8-9193-f0c9491fa1d8 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:18.678409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:18.679244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.679777 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.680267 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.680895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:18.682619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:18.697620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1300/2567] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:03:18.700077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:18.711619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf9ea4-3848-4a0e-8b08-e5f1706b4ce5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:18.717985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ff517-2791-46b2-9f07-a1cb56751f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:18.718631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ff517-2791-46b2-9f07-a1cb56751f2f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.718954 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ff517-2791-46b2-9f07-a1cb56751f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.719235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ff517-2791-46b2-9f07-a1cb56751f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.720257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ff517-2791-46b2-9f07-a1cb56751f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:18.721775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ff517-2791-46b2-9f07-a1cb56751f2f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:18.734472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1268/2568] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:03:18.740635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:18.752733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa76d05-258c-4c2a-8147-b0365b76c724 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:18.761246 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:18.762752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.763067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.763401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] PATH_INFO: `/v3/projects/2fe22edd9bc04749b7b83388f2a76db4/users/7008454a7c0f498e80e8e60655511893/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.780002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe22edd9bc04749b7b83388f2a76db4, user_id=7008454a7c0f498e80e8e60655511893, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:18.782684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:18.917633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1301/2569] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:03:18 2022] PUT /identity/v3/projects/2fe22edd9bc04749b7b83388f2a76db4/users/7008454a7c0f498e80e8e60655511893/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:03:18.927542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c5b81-40c1-4923-a282-60d04eee9229 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:18.927838 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c5b81-40c1-4923-a282-60d04eee9229 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:18.928126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92c5b81-40c1-4923-a282-60d04eee9229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:18.948156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e92c5b81-40c1-4923-a282-60d04eee9229 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:18.950060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e92c5b81-40c1-4923-a282-60d04eee9229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:19.015788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1269/2570] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:03:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:19.025961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:19.027892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:19.096685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3381f06d-24db-46b5-b22c-005339548c92 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:19.100746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5137478-7761-43ee-9dc4-485a3ac76b06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:19.101399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137478-7761-43ee-9dc4-485a3ac76b06 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:19.101685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137478-7761-43ee-9dc4-485a3ac76b06 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:19.101962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5137478-7761-43ee-9dc4-485a3ac76b06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:19.113735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5137478-7761-43ee-9dc4-485a3ac76b06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:19.120566 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5137478-7761-43ee-9dc4-485a3ac76b06 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:19.132896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1302/2571] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:20.106646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c5b81-40c1-4923-a282-60d04eee9229 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:20.117370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92c5b81-40c1-4923-a282-60d04eee9229 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:20.121237 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:20.121860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:20.122145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:20.122422 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:20.124257 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:20.134639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:20.136106 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:20.146280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1270/2572] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:20.700865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadaf4-c0f5-43cc-abcc-414358e405fc None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:20.701430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadaf4-c0f5-43cc-abcc-414358e405fc None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:20.701430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cadaf4-c0f5-43cc-abcc-414358e405fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:20.725152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-63cadaf4-c0f5-43cc-abcc-414358e405fc None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:20.726522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-63cadaf4-c0f5-43cc-abcc-414358e405fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:20.732869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:20.792401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1303/2573] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 07:03:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:20.806729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:20.808792 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:20.839767 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:20.898176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c3842-0cf7-4943-80a3-69cc147cb2c1 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:20.904390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:20.905019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:20.905291 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:20.905568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:20.914479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:20.916114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:20.925253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1271/2574] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:03:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:03:29.850466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ce45-1e69-4933-a1d4-9f7ae9190ead None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:29.851129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ce45-1e69-4933-a1d4-9f7ae9190ead None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:29.851129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0663ce45-1e69-4933-a1d4-9f7ae9190ead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:29.899446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0663ce45-1e69-4933-a1d4-9f7ae9190ead None None] MFA Rules not processed for user `7008454a7c0f498e80e8e60655511893`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:29.901170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0663ce45-1e69-4933-a1d4-9f7ae9190ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:30.021387 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1304/2575] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:03:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:30.037264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:30.039323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:30.145523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60470b16-5d05-4659-bde2-71a96802b2ae service swift] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:30.152724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9826b0ec-1bd6-46e8-b39b-1cd17a82a429 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:30.161804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b0ec-1bd6-46e8-b39b-1cd17a82a429 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:30.161804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b0ec-1bd6-46e8-b39b-1cd17a82a429 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:30.161804 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9826b0ec-1bd6-46e8-b39b-1cd17a82a429 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:30.166970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826b0ec-1bd6-46e8-b39b-1cd17a82a429 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:30.166970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9826b0ec-1bd6-46e8-b39b-1cd17a82a429 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:30.176259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1272/2576] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:33.624046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0b98-3ae5-4038-a5b8-5a8ae5251180 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:33.624834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0b98-3ae5-4038-a5b8-5a8ae5251180 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:33.624834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e0b98-3ae5-4038-a5b8-5a8ae5251180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:33.645022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f43e0b98-3ae5-4038-a5b8-5a8ae5251180 None None] MFA Rules not processed for user `7008454a7c0f498e80e8e60655511893`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:33.646278 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f43e0b98-3ae5-4038-a5b8-5a8ae5251180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:33.653720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1305/2577] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:03:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:36.409097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b06b6-fbda-4247-92ea-c25f1445c8e5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:36.409664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b06b6-fbda-4247-92ea-c25f1445c8e5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:36.409664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b06b6-fbda-4247-92ea-c25f1445c8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:36.431774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-445b06b6-fbda-4247-92ea-c25f1445c8e5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:36.433085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-445b06b6-fbda-4247-92ea-c25f1445c8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:36.443879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1273/2578] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:03:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:36.460294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e0b98-3ae5-4038-a5b8-5a8ae5251180 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:36.474247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e0b98-3ae5-4038-a5b8-5a8ae5251180 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:36.481072 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:36.481764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:36.482140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:36.482447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:36.491353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:36.493412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:36.503093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1306/2579] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:03:36.888413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0a0d-1058-4050-b514-096c9a6be8e6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:36.888701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0a0d-1058-4050-b514-096c9a6be8e6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:36.888978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396c0a0d-1058-4050-b514-096c9a6be8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:36.908033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-396c0a0d-1058-4050-b514-096c9a6be8e6 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:36.911336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-396c0a0d-1058-4050-b514-096c9a6be8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:36.916790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1274/2580] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 07:03:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:36.930481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:36.943729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8285e-898d-43c3-9168-d4ef115eca21 service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:36.951152 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:36.951882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:36.952214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:36.952491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:36.965974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:36.965974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:36.972186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1307/2581] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:03:41.042013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67815094-625a-456f-b2bc-e715aa730320 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:41.042941 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67815094-625a-456f-b2bc-e715aa730320 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:41.043397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67815094-625a-456f-b2bc-e715aa730320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:41.063841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-67815094-625a-456f-b2bc-e715aa730320 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:41.065086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-67815094-625a-456f-b2bc-e715aa730320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:41.073363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1275/2582] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:41.093047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:41.094460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:41.110475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8474835-edea-4fe8-b68c-a272b9fc2d06 service swift] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:41.116554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0262f3d6-ebee-494a-9962-3dad25ff13fe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:41.117171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f3d6-ebee-494a-9962-3dad25ff13fe service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:41.117558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f3d6-ebee-494a-9962-3dad25ff13fe service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:41.117734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0262f3d6-ebee-494a-9962-3dad25ff13fe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:41.127002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262f3d6-ebee-494a-9962-3dad25ff13fe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:41.128622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0262f3d6-ebee-494a-9962-3dad25ff13fe service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:41.139370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1308/2583] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:41.280482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67815094-625a-456f-b2bc-e715aa730320 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:41.295016 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67815094-625a-456f-b2bc-e715aa730320 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:41.300939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:41.301617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:41.301900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:41.302173 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:41.304030 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:41.318228 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:41.319934 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:41.332766 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1276/2584] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:43.823498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0ed4-9053-45df-aa2c-2e525c77ebb9 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:43.824074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0ed4-9053-45df-aa2c-2e525c77ebb9 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:43.824074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14b0ed4-9053-45df-aa2c-2e525c77ebb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:43.843699 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a14b0ed4-9053-45df-aa2c-2e525c77ebb9 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:43.844905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a14b0ed4-9053-45df-aa2c-2e525c77ebb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:43.852686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1309/2585] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:43.886528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:43.898238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c40dd9-5cc4-4c21-accd-5adc321f052b service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:43.904520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69338ba9-811d-49dd-97a9-5f9115efcd6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:43.905132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69338ba9-811d-49dd-97a9-5f9115efcd6d service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:43.905414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69338ba9-811d-49dd-97a9-5f9115efcd6d service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:43.905689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69338ba9-811d-49dd-97a9-5f9115efcd6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:43.914304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69338ba9-811d-49dd-97a9-5f9115efcd6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:43.915908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69338ba9-811d-49dd-97a9-5f9115efcd6d service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:43.926294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1277/2586] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:46.949610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b0ed4-9053-45df-aa2c-2e525c77ebb9 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:46.961845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14b0ed4-9053-45df-aa2c-2e525c77ebb9 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:46.967304 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:46.967985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:46.968271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:46.968546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:46.970329 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:46.983118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:46.984721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:46.995195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1310/2587] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:47.164588 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991db45-99bb-4bd2-817f-d2ded302fcd5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:47.165110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991db45-99bb-4bd2-817f-d2ded302fcd5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:47.165231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991db45-99bb-4bd2-817f-d2ded302fcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:47.186108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7991db45-99bb-4bd2-817f-d2ded302fcd5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:47.187400 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7991db45-99bb-4bd2-817f-d2ded302fcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:47.196729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1278/2588] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:47.214864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:47.227320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8dbe54-2553-42f0-8762-0f005dda6428 service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:47.232930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:47.233532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:47.233816 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:47.234092 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:47.243046 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:47.247575 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:47.255866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1311/2589] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:03:51.399895 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:51.400450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:51.400614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:51.409225 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=81 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:51.423131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:03:51.424363 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:03:51.432712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1279/2590] 10.222.0.27 () {58 vars in 1016 bytes} [Wed Aug 24 07:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:03:51.447969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:03:51.453821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:03:51.460104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e1edd-3abe-4736-896e-65fc844f197e service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:03:51.465659 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:03:51.466263 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:03:51.468484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:03:51.468484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:03:51.475406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:03:51.477089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:03:51.488140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1312/2591] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:04:01.437952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:04:01.494677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:04:23.352097 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:23.353612 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:23.366147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f021b188-d4e6-4969-92bb-6ace02664ae5 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:23.369775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:23.370373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:23.370655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:23.370961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:23.372689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:23.385702 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:23.387171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:23.396877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1280/2592] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:04:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:04:26.487835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:26.489224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:26.580969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d3efb9-6418-4faa-a875-6cd515d3d945 service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:26.587290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:26.587923 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:26.591656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:26.591656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:26.591656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:26.604168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:26.605935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:26.619732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1313/2593] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:04:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:04:26.767109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:26.768706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:26.782146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5363efe-c3ad-4c10-bec4-a6b99e62a6fe service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:26.786906 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:26.787539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:26.787823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:26.788100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] PATH_INFO: `/v3/users/6e845e38f3984215be78abf353cad81a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:26.789255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e845e38f3984215be78abf353cad81a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:26.791209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:27.057350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e845e38f3984215be78abf353cad81a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.058192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e845e38f3984215be78abf353cad81a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.176527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e845e38f3984215be78abf353cad81a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.193457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e845e38f3984215be78abf353cad81a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.201788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e845e38f3984215be78abf353cad81a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.209989 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1281/2594] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:04:26 2022] DELETE /identity/v3/users/6e845e38f3984215be78abf353cad81a => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:04:27.646118 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:27.658663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed1433-b6a5-47e9-8e93-d8e6cacffa26 service placement] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:27.729126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:27.729764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:27.730052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:27.730325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] PATH_INFO: `/v3/projects/45fd13e3fd8f43e8a47a75b16fdc08e0` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:27.731549 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45fd13e3fd8f43e8a47a75b16fdc08e0)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:27.733467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:27.773642 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:27.776086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:27.795871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6c414e-bd63-468e-8e25-933d33472c60 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:27.801969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:27.802724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:27.803177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:27.803585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] PATH_INFO: `/v3/users/024eb38f66684644b1d0b38b3f297ce8` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:27.804870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] RBAC: Authorizing `identity:delete_user(user_id=024eb38f66684644b1d0b38b3f297ce8)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:27.807176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:27.864133 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45fd13e3fd8f43e8a47a75b16fdc08e0', 'request_id': 'req-a4671942-c4ac-4e7c-a5cf-11a911f202f6'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.870096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45fd13e3fd8f43e8a47a75b16fdc08e0', 'request_id': 'req-a4671942-c4ac-4e7c-a5cf-11a911f202f6'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.964893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45fd13e3fd8f43e8a47a75b16fdc08e0', 'request_id': 'req-a4671942-c4ac-4e7c-a5cf-11a911f202f6'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.976852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] The token cache is being invalidate because project 45fd13e3fd8f43e8a47a75b16fdc08e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:04:27.977145 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.977783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:27.979292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1314/2595] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:04:27 2022] DELETE /identity/v3/projects/45fd13e3fd8f43e8a47a75b16fdc08e0 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:04:28.044270 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '024eb38f66684644b1d0b38b3f297ce8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.044969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '024eb38f66684644b1d0b38b3f297ce8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.222382 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '024eb38f66684644b1d0b38b3f297ce8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.236369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '024eb38f66684644b1d0b38b3f297ce8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.243488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-a52773e9-dbfe-4a61-854f-a816ddb6403c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '024eb38f66684644b1d0b38b3f297ce8'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.250330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1282/2596] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:04:27 2022] DELETE /identity/v3/users/024eb38f66684644b1d0b38b3f297ce8 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:04:28.538221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:28.539686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:28.565753 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:04:28.626901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4671942-c4ac-4e7c-a5cf-11a911f202f6 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:28.685677 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:28.686372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:28.686584 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:28.686942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] PATH_INFO: `/v3/projects/1e87020e3db0420cbd064383f9f0ed3a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:28.688350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e87020e3db0420cbd064383f9f0ed3a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:28.690355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:28.811497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e87020e3db0420cbd064383f9f0ed3a', 'request_id': 'req-6a96b785-496f-48de-9cfb-d6e3ca7ae124'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.817692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e87020e3db0420cbd064383f9f0ed3a', 'request_id': 'req-6a96b785-496f-48de-9cfb-d6e3ca7ae124'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.891505 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e87020e3db0420cbd064383f9f0ed3a', 'request_id': 'req-6a96b785-496f-48de-9cfb-d6e3ca7ae124'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.903484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] The token cache is being invalidate because project 1e87020e3db0420cbd064383f9f0ed3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:04:28.903779 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.904450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-6a96b785-496f-48de-9cfb-d6e3ca7ae124 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:04:28.906463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1315/2597] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:04:28 2022] DELETE /identity/v3/projects/1e87020e3db0420cbd064383f9f0ed3a => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:04:28.911774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8fa2-0ca4-4028-8228-e26165e6738d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:28.912412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8fa2-0ca4-4028-8228-e26165e6738d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:28.912538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ac8fa2-0ca4-4028-8228-e26165e6738d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:28.932490 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a2ac8fa2-0ca4-4028-8228-e26165e6738d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:04:28.933745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a2ac8fa2-0ca4-4028-8228-e26165e6738d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:28.961024 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:04:28.994833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1283/2598] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:04:29.003711 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4d3b-352c-4dfe-92b5-9b9175f2dacc None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.004002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4d3b-352c-4dfe-92b5-9b9175f2dacc None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.004290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b4d3b-352c-4dfe-92b5-9b9175f2dacc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.025106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5c5b4d3b-352c-4dfe-92b5-9b9175f2dacc None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:04:29.026336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5c5b4d3b-352c-4dfe-92b5-9b9175f2dacc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:29.034833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1316/2599] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:04:29.039340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8fa2-0ca4-4028-8228-e26165e6738d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:29.049794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ac8fa2-0ca4-4028-8228-e26165e6738d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:29.054342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:29.054977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.055681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.055962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.056613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:04:29.056921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:29.058518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:29.070477 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1284/2600] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:04:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:04:29.074885 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b4d3b-352c-4dfe-92b5-9b9175f2dacc None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:29.084153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b4d3b-352c-4dfe-92b5-9b9175f2dacc None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:29.088852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:29.089495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.089775 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.090047 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.090669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:29.092595 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:29.253921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1317/2601] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:04:29 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:04:29.263933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:29.273978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c4863-33ab-4ba0-989e-e229765cac33 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:29.331555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:29.332079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.332356 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.332627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.333253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:29.335231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:29.440478 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1285/2602] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:04:29 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:04:29.444676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:29.456187 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8431b35-124f-47a0-9ab8-23a5515569cd admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:29.461223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:29.464754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.464754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.464754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.464754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:29.464754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:29.476356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1318/2603] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:04:29.480367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:29.491675 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cf508c-f018-4bd7-b281-fdbf623d7bfb admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:29.496298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cead2b5-bb99-4a73-baa3-90a28dc13843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:29.502250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead2b5-bb99-4a73-baa3-90a28dc13843 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.502250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead2b5-bb99-4a73-baa3-90a28dc13843 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.502250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cead2b5-bb99-4a73-baa3-90a28dc13843 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.502250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cead2b5-bb99-4a73-baa3-90a28dc13843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:29.502250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cead2b5-bb99-4a73-baa3-90a28dc13843 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:29.511415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1286/2604] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:04:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:04:29.516431 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:29.526726 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a3a8b2-8c14-4dd9-be05-91589b50692c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:29.532309 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:29.533010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.533295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.533572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] PATH_INFO: `/v3/projects/ce38c475e88945f4835b3d579da2f9fe/users/65073017263e40358a97cc1dca7570ff/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.548276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce38c475e88945f4835b3d579da2f9fe, user_id=65073017263e40358a97cc1dca7570ff, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:29.550975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:29.553225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:04:29.680410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1319/2605] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:04:29 2022] PUT /identity/v3/projects/ce38c475e88945f4835b3d579da2f9fe/users/65073017263e40358a97cc1dca7570ff/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:04:29.685770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b841-3038-45f8-883e-883746e07e6d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.686179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b841-3038-45f8-883e-883746e07e6d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.686541 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b9b841-3038-45f8-883e-883746e07e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.708165 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-c8b9b841-3038-45f8-883e-883746e07e6d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:04:29.714305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c8b9b841-3038-45f8-883e-883746e07e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:29.772090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1287/2606] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:04:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:04:29.782182 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:29.784157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:29.842607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d593b-1194-4ac4-afe2-23e75b4813cc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:29.852602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0c13b-f025-43de-905f-b38924c3e158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:29.852602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c13b-f025-43de-905f-b38924c3e158 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:29.852602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c13b-f025-43de-905f-b38924c3e158 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:29.852602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0c13b-f025-43de-905f-b38924c3e158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:29.856990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0c13b-f025-43de-905f-b38924c3e158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:29.858450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0c13b-f025-43de-905f-b38924c3e158 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:29.868982 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1320/2607] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:04:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:04:35.968899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:35.969444 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:35.969540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:35.999839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] MFA Rules not processed for user `7008454a7c0f498e80e8e60655511893`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:04:35.999839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:36.038378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:04:36.069145 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1288/2608] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:04:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:04:36.298801 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5450d7-cbcd-4ad6-ae24-4b7541397ff0 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:36.299356 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5450d7-cbcd-4ad6-ae24-4b7541397ff0 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:36.299561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5450d7-cbcd-4ad6-ae24-4b7541397ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:36.329076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3c5450d7-cbcd-4ad6-ae24-4b7541397ff0 None None] MFA Rules not processed for user `65073017263e40358a97cc1dca7570ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:04:36.330349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3c5450d7-cbcd-4ad6-ae24-4b7541397ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:36.417657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1321/2609] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:04:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:04:36.432438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:36.433866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:36.477974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5450d7-cbcd-4ad6-ae24-4b7541397ff0 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:04:36.488881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5450d7-cbcd-4ad6-ae24-4b7541397ff0 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:36.492833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bcdd56-c2f9-4269-b5ea-355f752f00e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:36.493461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcdd56-c2f9-4269-b5ea-355f752f00e6 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:36.493759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcdd56-c2f9-4269-b5ea-355f752f00e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:36.494007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bcdd56-c2f9-4269-b5ea-355f752f00e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:36.497540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-14bcdd56-c2f9-4269-b5ea-355f752f00e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:36.508321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcdd56-c2f9-4269-b5ea-355f752f00e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:36.509867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bcdd56-c2f9-4269-b5ea-355f752f00e6 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:36.525111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1322/2610] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:04:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:04:36.535627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86edde-00d7-4d9e-8820-8c2f2720b9a3 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:04:36.541681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4accaa-3387-4f54-b050-0c4f810c6f30 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:04:36.542392 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4accaa-3387-4f54-b050-0c4f810c6f30 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:36.542673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4accaa-3387-4f54-b050-0c4f810c6f30 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:36.542978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4accaa-3387-4f54-b050-0c4f810c6f30 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:36.552793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4accaa-3387-4f54-b050-0c4f810c6f30 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:04:36.554472 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4accaa-3387-4f54-b050-0c4f810c6f30 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:04:36.565501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1289/2611] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:04:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:04:39.630255 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8a20-1462-4dbc-8594-c970a0547636 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:04:39.630742 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8a20-1462-4dbc-8594-c970a0547636 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:04:39.630900 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c8a20-1462-4dbc-8594-c970a0547636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:04:39.651310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c17c8a20-1462-4dbc-8594-c970a0547636 None None] MFA Rules not processed for user `65073017263e40358a97cc1dca7570ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:04:39.652468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c17c8a20-1462-4dbc-8594-c970a0547636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:04:39.662002 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1323/2612] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:04:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:04:46.560531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=42 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:04:49.646288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:INSERT=1,keystone:SELECT=69 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:05:46.214555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:05:46.215121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:05:46.215121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:05:46.235365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] MFA Rules not processed for user `7008454a7c0f498e80e8e60655511893`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:05:46.236519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:05:46.243665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1290/2613] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:05:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:05:56.229842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:06:01.261218 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8a20-1462-4dbc-8594-c970a0547636 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:06:01.337360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c8a20-1462-4dbc-8594-c970a0547636 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:06:01.344785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5c9503-69af-4dae-acae-b942054e5b41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:06:01.345409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c9503-69af-4dae-acae-b942054e5b41 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:06:01.345692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c9503-69af-4dae-acae-b942054e5b41 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:06:01.346126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5c9503-69af-4dae-acae-b942054e5b41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:06:01.347914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ac5c9503-69af-4dae-acae-b942054e5b41 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:06:01.389478 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c9503-69af-4dae-acae-b942054e5b41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:06:01.392330 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5c9503-69af-4dae-acae-b942054e5b41 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:06:01.405560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1324/2614] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:06:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:06:03.391028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:06:03.392506 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:06:03.507495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ca7e38-b3c1-451a-8425-b5971f2181fe None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:06:03.513131 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2b8854-d58a-46d9-a562-8cea9c90bfc3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:06:03.513743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8854-d58a-46d9-a562-8cea9c90bfc3 service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:06:03.514025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8854-d58a-46d9-a562-8cea9c90bfc3 service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:06:03.514302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2b8854-d58a-46d9-a562-8cea9c90bfc3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:06:03.516059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cf2b8854-d58a-46d9-a562-8cea9c90bfc3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:06:03.528462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b8854-d58a-46d9-a562-8cea9c90bfc3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:06:03.530080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2b8854-d58a-46d9-a562-8cea9c90bfc3 service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:06:03.540083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1291/2615] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:06:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:06:11.400466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=39 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:06:13.535822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=53 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:06:52.946798 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68b28-5779-4b4d-a7bf-06535dc40055 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:06:52.947385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68b28-5779-4b4d-a7bf-06535dc40055 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:06:52.947385 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa68b28-5779-4b4d-a7bf-06535dc40055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:06:52.966390 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3fa68b28-5779-4b4d-a7bf-06535dc40055 None None] MFA Rules not processed for user `7008454a7c0f498e80e8e60655511893`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:06:52.967637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3fa68b28-5779-4b4d-a7bf-06535dc40055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:06:52.974672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1325/2616] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:06:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:07:02.961168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:07:23.249493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0aa2-a740-493c-b741-68337ea5af22 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:07:23.250031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0aa2-a740-493c-b741-68337ea5af22 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:07:23.250175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b0aa2-a740-493c-b741-68337ea5af22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:07:23.269127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a70b0aa2-a740-493c-b741-68337ea5af22 None None] MFA Rules not processed for user `65073017263e40358a97cc1dca7570ff`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:07:23.270342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a70b0aa2-a740-493c-b741-68337ea5af22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:07:23.277278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1292/2617] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:07:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:07:33.263911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:07:53.482609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68b28-5779-4b4d-a7bf-06535dc40055 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:07:53.502103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa68b28-5779-4b4d-a7bf-06535dc40055 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:07:53.505680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:07:53.506277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:07:53.506558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:07:53.506869 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:07:53.508592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:07:53.522265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:07:53.523710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:07:53.534412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1326/2618] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:07:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:07:54.710511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b0aa2-a740-493c-b741-68337ea5af22 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:07:54.721452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b0aa2-a740-493c-b741-68337ea5af22 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:07:54.725162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:07:54.727962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:07:54.727962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:07:54.727962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:07:54.728287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:07:54.741847 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:07:54.743321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:07:54.754706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1293/2619] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:07:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:03.529663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=10 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:04.749844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=6 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:07.214140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:07.226146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4cce6a-7703-4a79-adfd-7fda7b823803 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:07.231634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:07.232349 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:07.232645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:07.232924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:07.234792 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:07.248475 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:07.250103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:07.262799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1327/2620] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:07.374183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:07.377210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:07.425387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e782eb-db3f-4b8c-9891-9e1ec1529dbd service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:07.427623 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:07.428271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:07.428577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:07.428860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] PATH_INFO: `/v3/users/7008454a7c0f498e80e8e60655511893` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:07.430026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7008454a7c0f498e80e8e60655511893)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:07.432013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:07.657428 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7008454a7c0f498e80e8e60655511893'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:07.658402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7008454a7c0f498e80e8e60655511893'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:07.756048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7008454a7c0f498e80e8e60655511893'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:07.769536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7008454a7c0f498e80e8e60655511893'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:07.776206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6d1455bb-f1be-4dfb-88ab-222632447238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7008454a7c0f498e80e8e60655511893'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:07.782109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1294/2621] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:07 2022] DELETE /identity/v3/users/7008454a7c0f498e80e8e60655511893 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:08.161224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:08.173398 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39131a-58af-46bd-95a6-acb5a288cf9a service placement] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:08.230094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:08.230847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:08.231037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:08.231375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] PATH_INFO: `/v3/projects/2fe22edd9bc04749b7b83388f2a76db4` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:08.232483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe22edd9bc04749b7b83388f2a76db4)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:08.235342 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:08.384643 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe22edd9bc04749b7b83388f2a76db4', 'request_id': 'req-af8b1969-1927-4e98-a3b5-7854fd90beb6'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:08.390095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe22edd9bc04749b7b83388f2a76db4', 'request_id': 'req-af8b1969-1927-4e98-a3b5-7854fd90beb6'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:08.446994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe22edd9bc04749b7b83388f2a76db4', 'request_id': 'req-af8b1969-1927-4e98-a3b5-7854fd90beb6'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:08.458867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] The token cache is being invalidate because project 2fe22edd9bc04749b7b83388f2a76db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:08.464414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:08.464414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-af8b1969-1927-4e98-a3b5-7854fd90beb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:08.464414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1328/2622] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:08 2022] DELETE /identity/v3/projects/2fe22edd9bc04749b7b83388f2a76db4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:08.466562 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c867f8-2255-46c2-93cb-5d3a5ae25e0e None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:08.467065 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c867f8-2255-46c2-93cb-5d3a5ae25e0e None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:08.467160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c867f8-2255-46c2-93cb-5d3a5ae25e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:08.522783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a8c867f8-2255-46c2-93cb-5d3a5ae25e0e None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:08.524009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a8c867f8-2255-46c2-93cb-5d3a5ae25e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:08.582025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1295/2623] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:08.590154 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f753ed9-508d-44b8-b35c-63b2f991bdc4 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:08.590444 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f753ed9-508d-44b8-b35c-63b2f991bdc4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:08.590725 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f753ed9-508d-44b8-b35c-63b2f991bdc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:08.611234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6f753ed9-508d-44b8-b35c-63b2f991bdc4 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:08.612462 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6f753ed9-508d-44b8-b35c-63b2f991bdc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:08.620599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1329/2624] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:08:08.624832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c867f8-2255-46c2-93cb-5d3a5ae25e0e None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:08.634484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c867f8-2255-46c2-93cb-5d3a5ae25e0e None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:08.639084 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:08.639684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:08.639969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:08.640244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:08.640890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:08.641196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:08.642786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:08.651260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:08.654423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1296/2625] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:08:08.659567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f753ed9-508d-44b8-b35c-63b2f991bdc4 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:08.669224 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f753ed9-508d-44b8-b35c-63b2f991bdc4 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:08.674904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:08.675520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:08.675795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:08.676066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:08.676731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:08.678664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:08.787685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1330/2626] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:08 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:08.791970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:08.802869 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7b77a4-5d9e-433b-8689-ee5d36fd4d60 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:08.857680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:08.858279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:08.858560 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:08.858875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:08.860174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:08.862133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:08.962125 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1297/2627] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:08 2022] POST /identity/v3/users => generated 302 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:08.966273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:08.977313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733222e1-43ff-4855-8b76-dfa206941b74 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:08.981564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:08.982160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:08.982438 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:08.982713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:08.983412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:08.985651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:08.995839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1331/2628] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:09.000054 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:09.010224 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55de9a94-03f9-4a04-a509-a065cc5d1bde admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:09.016759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fbfad3-5234-4815-9643-b988c999edfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:09.017367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfad3-5234-4815-9643-b988c999edfb admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:09.017654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfad3-5234-4815-9643-b988c999edfb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:09.017928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fbfad3-5234-4815-9643-b988c999edfb admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:09.018576 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbfad3-5234-4815-9643-b988c999edfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:09.020380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fbfad3-5234-4815-9643-b988c999edfb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:09.031143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1298/2629] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:09.035967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:09.045889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40098b-2bb6-4f6b-8c14-d1d3abd3fba2 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:09.050466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:09.051146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:09.051430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:09.051707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] PATH_INFO: `/v3/projects/f49b271094ab454faca7926cc875b89d/users/1d55bc5dd7ff4082a98b8b4292130fe7/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:09.065965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f49b271094ab454faca7926cc875b89d, user_id=1d55bc5dd7ff4082a98b8b4292130fe7, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:09.068629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:09.166124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1332/2630] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:09 2022] PUT /identity/v3/projects/f49b271094ab454faca7926cc875b89d/users/1d55bc5dd7ff4082a98b8b4292130fe7/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:09.171666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc03e-be25-4e2c-ac6c-9a71ae9dd717 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:09.172036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc03e-be25-4e2c-ac6c-9a71ae9dd717 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:09.172284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc03e-be25-4e2c-ac6c-9a71ae9dd717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:09.191566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-08bcc03e-be25-4e2c-ac6c-9a71ae9dd717 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:09.192826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-08bcc03e-be25-4e2c-ac6c-9a71ae9dd717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:09.253086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1299/2631] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:09.262698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:09.264544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:09.269935 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:09.336070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a82e1d-1296-4242-ac0e-e7c924e3c2b1 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:09.339763 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:09.340375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:09.340650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:09.340925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:09.350407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:09.351880 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:09.361591 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1333/2632] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:10.649309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89622-1083-4223-a6f8-afd3db1df014 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:10.656923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89622-1083-4223-a6f8-afd3db1df014 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:10.656923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d89622-1083-4223-a6f8-afd3db1df014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:10.681189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-13d89622-1083-4223-a6f8-afd3db1df014 None None] MFA Rules not processed for user `1d55bc5dd7ff4082a98b8b4292130fe7`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:10.682460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-13d89622-1083-4223-a6f8-afd3db1df014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:10.760975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1300/2633] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:10 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:10.766032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:10.778166 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8b274d-fda8-42f6-b5b9-288bbf8fd4b6 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:10.785544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:10.786235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:10.787015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:10.787314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:10.788226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:10.790386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:10.906738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1334/2634] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:10 2022] POST /identity/v3/projects => generated 403 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:10.910643 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89622-1083-4223-a6f8-afd3db1df014 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:10.921319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d89622-1083-4223-a6f8-afd3db1df014 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:10.925774 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:10.978094 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:10.978710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:10.979027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:10.979310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:10.979956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:10.981889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:11.139067 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1301/2635] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:10 2022] POST /identity/v3/users => generated 308 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:11.143561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:11.153717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562491e9-23a3-4e25-bebb-7e1f60778309 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:11.158163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:11.158749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:11.159149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:11.159424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:11.160059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:11.161636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:11.172057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1335/2636] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:11.176235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:11.186467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02189ac1-5214-463e-b7dc-8df1f0bb933b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:11.191803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:11.192458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:11.193019 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:11.193305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] PATH_INFO: `/v3/projects/5832b4c3cfb046d5805a3af86e58a559/users/962598366249430fa6e532acb2363d2a/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:11.209033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5832b4c3cfb046d5805a3af86e58a559, user_id=962598366249430fa6e532acb2363d2a, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:11.211724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:11.269803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1302/2637] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:11 2022] PUT /identity/v3/projects/5832b4c3cfb046d5805a3af86e58a559/users/962598366249430fa6e532acb2363d2a/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:11.273852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:11.284136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bc13b8-16b6-4044-bcb3-5763105b0ad7 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:11.340245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef48d791-5b99-47f1-a598-1ffcdde354a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:11.340845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d791-5b99-47f1-a598-1ffcdde354a7 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:11.341127 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d791-5b99-47f1-a598-1ffcdde354a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:11.341399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef48d791-5b99-47f1-a598-1ffcdde354a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:11.342033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48d791-5b99-47f1-a598-1ffcdde354a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:11.344318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef48d791-5b99-47f1-a598-1ffcdde354a7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:11.353773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1336/2638] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:11.358027 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:11.368766 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab04c0b9-4bcf-4d7f-8ca9-95982884d163 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:11.373541 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:11.374204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:11.374482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:11.374790 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] PATH_INFO: `/v3/projects/5832b4c3cfb046d5805a3af86e58a559/users/962598366249430fa6e532acb2363d2a/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:11.376712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5832b4c3cfb046d5805a3af86e58a559, user_id=962598366249430fa6e532acb2363d2a, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:11.379421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:11.389667 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1303/2639] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:11 2022] PUT /identity/v3/projects/5832b4c3cfb046d5805a3af86e58a559/users/962598366249430fa6e532acb2363d2a/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:12.722689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246506-5f63-43a9-8507-09ffd96d1846 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:12.723253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246506-5f63-43a9-8507-09ffd96d1846 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:12.723350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1246506-5f63-43a9-8507-09ffd96d1846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:12.752112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f1246506-5f63-43a9-8507-09ffd96d1846 None None] MFA Rules not processed for user `962598366249430fa6e532acb2363d2a`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:12.753339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f1246506-5f63-43a9-8507-09ffd96d1846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:12.803490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:12.826919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1337/2640] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:14.275882 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:14.341238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f695c4-eae9-4a84-a4d6-36922898b598 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:14.345980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:14.346616 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:14.346952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:14.347235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] PATH_INFO: `/v3/users/1d55bc5dd7ff4082a98b8b4292130fe7` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:14.348402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d55bc5dd7ff4082a98b8b4292130fe7)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:14.350362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:14.685114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d55bc5dd7ff4082a98b8b4292130fe7'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:14.685791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d55bc5dd7ff4082a98b8b4292130fe7'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:14.795823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d55bc5dd7ff4082a98b8b4292130fe7'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:14.805127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=85,keystone:INSERT=6,keystone:DELETE=9 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:14.810503 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d55bc5dd7ff4082a98b8b4292130fe7'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:14.817335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d55bc5dd7ff4082a98b8b4292130fe7'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:14.823758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1304/2641] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:14 2022] DELETE /identity/v3/users/1d55bc5dd7ff4082a98b8b4292130fe7 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:15.135542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246506-5f63-43a9-8507-09ffd96d1846 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:15.146946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1246506-5f63-43a9-8507-09ffd96d1846 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:15.219648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:15.220822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:15.221264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:15.221829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] PATH_INFO: `/v3/projects/f49b271094ab454faca7926cc875b89d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:15.223185 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f49b271094ab454faca7926cc875b89d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:15.228415 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:15.325836 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f49b271094ab454faca7926cc875b89d', 'request_id': 'req-369e0c46-a4f6-40f1-846c-07b281c56d49'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.331761 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f49b271094ab454faca7926cc875b89d', 'request_id': 'req-369e0c46-a4f6-40f1-846c-07b281c56d49'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.435907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f49b271094ab454faca7926cc875b89d', 'request_id': 'req-369e0c46-a4f6-40f1-846c-07b281c56d49'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.447965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] The token cache is being invalidate because project f49b271094ab454faca7926cc875b89d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:15.448257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.448895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.450376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1338/2642] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:15 2022] DELETE /identity/v3/projects/f49b271094ab454faca7926cc875b89d => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:15.454377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:15.455821 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:15.469083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0c45d6-bbab-461b-b2e8-8f34bf16b6ac admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:15.526123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:15.526832 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:15.527114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:15.527390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] PATH_INFO: `/v3/users/962598366249430fa6e532acb2363d2a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:15.528502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] RBAC: Authorizing `identity:delete_user(user_id=962598366249430fa6e532acb2363d2a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:15.530399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:15.726347 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '962598366249430fa6e532acb2363d2a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.727071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '962598366249430fa6e532acb2363d2a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.807432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '962598366249430fa6e532acb2363d2a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.820311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '962598366249430fa6e532acb2363d2a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.827366 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-042c0d84-5b49-451b-8826-a538d2dd2806 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '962598366249430fa6e532acb2363d2a'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:15.834105 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1305/2643] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:15 2022] DELETE /identity/v3/users/962598366249430fa6e532acb2363d2a => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:16.089767 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:16.091358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:16.106096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e0c46-a4f6-40f1-846c-07b281c56d49 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:16.165811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:16.166535 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.166708 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.168865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] PATH_INFO: `/v3/projects/5832b4c3cfb046d5805a3af86e58a559` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.168865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5832b4c3cfb046d5805a3af86e58a559)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:16.170005 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:16.186635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:16.305239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5832b4c3cfb046d5805a3af86e58a559', 'request_id': 'req-f6d144df-e56f-4d43-9db9-83b3cd939571'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:16.310758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5832b4c3cfb046d5805a3af86e58a559', 'request_id': 'req-f6d144df-e56f-4d43-9db9-83b3cd939571'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:16.371038 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5832b4c3cfb046d5805a3af86e58a559', 'request_id': 'req-f6d144df-e56f-4d43-9db9-83b3cd939571'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:16.384168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] The token cache is being invalidate because project 5832b4c3cfb046d5805a3af86e58a559 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:16.386477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:16.386477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-f6d144df-e56f-4d43-9db9-83b3cd939571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:16.386746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1339/2644] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:16 2022] DELETE /identity/v3/projects/5832b4c3cfb046d5805a3af86e58a559 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:16.392841 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a2964-5e95-4eb1-af1e-ddac5fe08464 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.393314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a2964-5e95-4eb1-af1e-ddac5fe08464 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.393726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a2964-5e95-4eb1-af1e-ddac5fe08464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.413740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-950a2964-5e95-4eb1-af1e-ddac5fe08464 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:16.415029 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-950a2964-5e95-4eb1-af1e-ddac5fe08464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:16.465967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:16.474149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1306/2645] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:16.483256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a285-1e1e-4c4d-bd1c-9a2f38be42e7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.483657 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a285-1e1e-4c4d-bd1c-9a2f38be42e7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.483938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a989a285-1e1e-4c4d-bd1c-9a2f38be42e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.504703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a989a285-1e1e-4c4d-bd1c-9a2f38be42e7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:16.505916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a989a285-1e1e-4c4d-bd1c-9a2f38be42e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:16.514216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1340/2646] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:16.519174 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a2964-5e95-4eb1-af1e-ddac5fe08464 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:16.529152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950a2964-5e95-4eb1-af1e-ddac5fe08464 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:16.534234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:16.534904 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.535190 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.535467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.536147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:16.536450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:16.538045 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:16.550110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1307/2647] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:08:16.554593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a285-1e1e-4c4d-bd1c-9a2f38be42e7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:16.564784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a989a285-1e1e-4c4d-bd1c-9a2f38be42e7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:16.569508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:16.570395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.570676 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.570981 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.571610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:16.573513 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:16.689650 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1341/2648] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:16 2022] POST /identity/v3/projects => generated 375 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:16.694142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:16.704967 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200726c1-0bdd-4aac-816f-7fef4b4e1d1d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:16.766547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:16.767194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.767491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.767751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.768393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:16.770309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:16.878026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1308/2649] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:16 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:16.881103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:16.891810 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d15b1-2f6a-4032-9b89-b9d58c438482 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:16.896683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:16.897371 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.897684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.897961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.898607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:16.900273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:16.911343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1342/2650] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:16.915303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:16.925960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89377493-7d85-42b7-a585-3d0ba4cf1f10 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:16.930552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fefc5c-11f5-4df8-8498-d762978f0321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:16.931175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fefc5c-11f5-4df8-8498-d762978f0321 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.931457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fefc5c-11f5-4df8-8498-d762978f0321 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.931731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fefc5c-11f5-4df8-8498-d762978f0321 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.932395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fefc5c-11f5-4df8-8498-d762978f0321 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:16.933987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fefc5c-11f5-4df8-8498-d762978f0321 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:16.947887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1309/2651] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:16.949771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:16.960124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1982a18-9391-4a94-beb1-f01c313837c2 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:16.964878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:16.965526 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:16.965813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:16.966091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] PATH_INFO: `/v3/projects/cff85182d4e94ae69c06ca0b6f1245f0/users/e81b829d7e30446eb905a035921cc43d/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:16.981612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cff85182d4e94ae69c06ca0b6f1245f0, user_id=e81b829d7e30446eb905a035921cc43d, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:16.984355 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:17.128140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1343/2652] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:16 2022] PUT /identity/v3/projects/cff85182d4e94ae69c06ca0b6f1245f0/users/e81b829d7e30446eb905a035921cc43d/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:17.139613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f60a94-1e3f-4bc1-9c87-521e5c230b99 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.139994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f60a94-1e3f-4bc1-9c87-521e5c230b99 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.140360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f60a94-1e3f-4bc1-9c87-521e5c230b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:17.169534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b0f60a94-1e3f-4bc1-9c87-521e5c230b99 None None] MFA Rules not processed for user `e81b829d7e30446eb905a035921cc43d`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:17.171278 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b0f60a94-1e3f-4bc1-9c87-521e5c230b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:17.239155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1310/2653] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:17.250688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:17.334312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b2db8-d9a9-4255-b265-457e66353ff9 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:17.334312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:17.334312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.334312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.334637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:17.334637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:17.334637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:17.459090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1344/2654] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:17 2022] POST /identity/v3/projects => generated 375 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:08:17.463290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f60a94-1e3f-4bc1-9c87-521e5c230b99 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:17.473859 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f60a94-1e3f-4bc1-9c87-521e5c230b99 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:17.522717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:17.529314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:17.529923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.530206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.530481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:17.531261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:17.534654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:17.657739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1311/2655] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:17 2022] POST /identity/v3/users => generated 294 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:17.661670 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:17.671910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf07b51-d04e-4e9e-8ff0-5733ca1e504a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:17.677397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:17.677994 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.678287 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.678560 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:17.679233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:17.680828 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:17.691745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1345/2656] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:17.698147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:17.709260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d55671-211d-4058-b3a6-9abea27c6ad7 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:17.714169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:17.714879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.715171 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.715520 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] PATH_INFO: `/v3/projects/beb8424b35db4d3da1272f4df12f477d/users/ab1882ca030a4c06a403c975778f4a34/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:17.732789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb8424b35db4d3da1272f4df12f477d, user_id=ab1882ca030a4c06a403c975778f4a34, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:17.736208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:17.857593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1312/2657] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:17 2022] PUT /identity/v3/projects/beb8424b35db4d3da1272f4df12f477d/users/ab1882ca030a4c06a403c975778f4a34/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:17.862197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:17.872222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769311ad-98d8-4840-b40b-b01d318a6add admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:17.883933 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:17.929113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767971c-abee-46f3-a741-2ac66590f911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:17.929688 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767971c-abee-46f3-a741-2ac66590f911 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.930008 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767971c-abee-46f3-a741-2ac66590f911 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.930284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767971c-abee-46f3-a741-2ac66590f911 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:17.930965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767971c-abee-46f3-a741-2ac66590f911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:17.932568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f767971c-abee-46f3-a741-2ac66590f911 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:17.942306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1346/2658] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:17 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:17.946929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:17.958035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612af744-d91d-4ca2-814e-266064d6b222 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:17.963169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:17.963820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.964102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.964378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] PATH_INFO: `/v3/projects/beb8424b35db4d3da1272f4df12f477d/users/ab1882ca030a4c06a403c975778f4a34/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:17.966403 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=beb8424b35db4d3da1272f4df12f477d, user_id=ab1882ca030a4c06a403c975778f4a34, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:17.969147 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:17.980923 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1313/2659] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:17 2022] PUT /identity/v3/projects/beb8424b35db4d3da1272f4df12f477d/users/ab1882ca030a4c06a403c975778f4a34/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:17.991345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:17.991636 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:17.991918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:18.020126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] MFA Rules not processed for user `ab1882ca030a4c06a403c975778f4a34`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:18.021354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:18.089311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1347/2660] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:17 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:18.101306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:18.103072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:18.184103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c51a15f-2fc0-493b-b66f-8bbd825351fc admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:18.187735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:18.188336 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:18.188618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:18.188890 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:18.248244 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:18.249689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:18.260355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1314/2661] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:21.881479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:21.883021 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:21.895542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8de14-d306-4ad9-9a8b-e8c101047eb8 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:21.899314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad616c-5f6a-43c5-a681-02e2815cd1a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:21.899914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad616c-5f6a-43c5-a681-02e2815cd1a2 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:21.900195 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad616c-5f6a-43c5-a681-02e2815cd1a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:21.900474 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad616c-5f6a-43c5-a681-02e2815cd1a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:21.910285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad616c-5f6a-43c5-a681-02e2815cd1a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:21.916247 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad616c-5f6a-43c5-a681-02e2815cd1a2 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:21.921340 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1348/2662] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:21 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:28.257346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:31.917099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=62 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:37.232108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:37.295202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f603c9-4a40-4408-9cb4-59ecbaf4d686 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:37.299665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:37.300290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:37.300598 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:37.300873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] PATH_INFO: `/v3/users/e81b829d7e30446eb905a035921cc43d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:37.302003 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81b829d7e30446eb905a035921cc43d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:37.304076 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:37.544299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81b829d7e30446eb905a035921cc43d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:37.544976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81b829d7e30446eb905a035921cc43d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:37.633806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81b829d7e30446eb905a035921cc43d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:37.646118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81b829d7e30446eb905a035921cc43d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:37.652783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81b829d7e30446eb905a035921cc43d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:37.658604 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1315/2663] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:37 2022] DELETE /identity/v3/users/e81b829d7e30446eb905a035921cc43d => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:37.663217 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:37.663721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:37.663849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:37.683428 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:37.684778 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:37.748167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1349/2664] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:37.758460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:37.764359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:37.817519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9fdb8-f4e4-4c89-b281-beff24a08fda admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:37.821249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:37.821855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:37.822133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:37.822418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:37.831436 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:37.832938 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:37.842551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1316/2665] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:38.306019 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:38.310911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:38.320617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1401a4c4-ceed-41c0-b97f-bbd447bb25b3 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:38.325914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:38.326544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:38.326863 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:38.327137 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] PATH_INFO: `/v3/projects/cff85182d4e94ae69c06ca0b6f1245f0` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:38.328871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cff85182d4e94ae69c06ca0b6f1245f0)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:38.330892 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:38.545282 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cff85182d4e94ae69c06ca0b6f1245f0', 'request_id': 'req-e5b6485f-dd25-49b6-b483-b16ae4bae140'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:38.551130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cff85182d4e94ae69c06ca0b6f1245f0', 'request_id': 'req-e5b6485f-dd25-49b6-b483-b16ae4bae140'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:38.628173 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cff85182d4e94ae69c06ca0b6f1245f0', 'request_id': 'req-e5b6485f-dd25-49b6-b483-b16ae4bae140'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:38.647053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] The token cache is being invalidate because project cff85182d4e94ae69c06ca0b6f1245f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:38.647053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:38.647053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:38.647053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1350/2666] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:38 2022] DELETE /identity/v3/projects/cff85182d4e94ae69c06ca0b6f1245f0 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:38.647438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:38.657028 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac96b233-7825-4c31-a625-4309c0f97183 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:38.675411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:38.714344 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:38.715018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:38.715307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:38.715581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] PATH_INFO: `/v3/users/ab1882ca030a4c06a403c975778f4a34` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:38.716726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab1882ca030a4c06a403c975778f4a34)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:38.718654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:38.992797 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab1882ca030a4c06a403c975778f4a34'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:38.993387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab1882ca030a4c06a403c975778f4a34'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:39.171159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab1882ca030a4c06a403c975778f4a34'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:39.184432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab1882ca030a4c06a403c975778f4a34'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:39.191730 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-156dfb11-8918-4e85-9710-758a0662bda1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab1882ca030a4c06a403c975778f4a34'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:39.199638 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1317/2667] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:38 2022] DELETE /identity/v3/users/ab1882ca030a4c06a403c975778f4a34 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:39.711794 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:39.716161 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:39.737877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b6485f-dd25-49b6-b483-b16ae4bae140 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:39.803429 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:39.804103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:39.804394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:39.804672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] PATH_INFO: `/v3/projects/beb8424b35db4d3da1272f4df12f477d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:39.805824 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] RBAC: Authorizing `identity:delete_project(project_id=beb8424b35db4d3da1272f4df12f477d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:39.807807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:39.905881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:39.922937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beb8424b35db4d3da1272f4df12f477d', 'request_id': 'req-c7adf542-9095-4758-9eb0-3ccba3b5d472'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:39.928626 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beb8424b35db4d3da1272f4df12f477d', 'request_id': 'req-c7adf542-9095-4758-9eb0-3ccba3b5d472'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:40.024245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beb8424b35db4d3da1272f4df12f477d', 'request_id': 'req-c7adf542-9095-4758-9eb0-3ccba3b5d472'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:40.037717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] The token cache is being invalidate because project beb8424b35db4d3da1272f4df12f477d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:40.038007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:40.038656 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c7adf542-9095-4758-9eb0-3ccba3b5d472 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:40.040171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1351/2668] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:39 2022] DELETE /identity/v3/projects/beb8424b35db4d3da1272f4df12f477d => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:40.045262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a43e-b93c-4043-b315-68bf3be31aca None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.045775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a43e-b93c-4043-b315-68bf3be31aca None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.045883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6a43e-b93c-4043-b315-68bf3be31aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.065720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3cf6a43e-b93c-4043-b315-68bf3be31aca None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:40.066874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3cf6a43e-b93c-4043-b315-68bf3be31aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:40.128331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1318/2669] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:40.137454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeebaa6-0b95-4830-84fb-e90c3c81310c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.137851 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeebaa6-0b95-4830-84fb-e90c3c81310c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.138219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbeebaa6-0b95-4830-84fb-e90c3c81310c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.158194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-bbeebaa6-0b95-4830-84fb-e90c3c81310c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:40.159552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bbeebaa6-0b95-4830-84fb-e90c3c81310c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:40.167909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1352/2670] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:40.172457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6a43e-b93c-4043-b315-68bf3be31aca None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:40.182495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6a43e-b93c-4043-b315-68bf3be31aca None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:40.187458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:40.194484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.194484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.194484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.194484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:40.194484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:40.194484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:40.204978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1319/2671] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:08:40.209471 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeebaa6-0b95-4830-84fb-e90c3c81310c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:40.219582 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbeebaa6-0b95-4830-84fb-e90c3c81310c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:40.224439 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:40.225044 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.225333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.225609 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.226245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:40.228348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:40.369477 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1353/2672] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:40 2022] POST /identity/v3/projects => generated 391 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:40.373884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:40.385441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c73284-0a91-49e1-b16a-a9236340910e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:40.412814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:40.447072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:40.447699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.447985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.448265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.448922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:40.450875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:40.634707 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1320/2673] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:40 2022] POST /identity/v3/users => generated 296 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:40.638908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:40.649564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe236942-9efa-4d26-aaad-099a2f450d91 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:40.654274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:40.654954 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.655284 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.655557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.656203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:40.657939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:40.668668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1354/2674] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:08:40.673463 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:40.683654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f037a884-a498-42b4-8043-ba6a76e49ad6 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:40.689082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fae1415-73af-49c7-b707-bbe4266d2deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:40.689695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1415-73af-49c7-b707-bbe4266d2deb admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.689971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1415-73af-49c7-b707-bbe4266d2deb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.690241 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fae1415-73af-49c7-b707-bbe4266d2deb admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.690959 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae1415-73af-49c7-b707-bbe4266d2deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:40.692595 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fae1415-73af-49c7-b707-bbe4266d2deb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:40.707550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1321/2675] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:08:40.711960 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:40.722914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24d1f9a-bf07-471b-a681-0027c542e79b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:40.727706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:40.728364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.728644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.728941 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] PATH_INFO: `/v3/projects/e0c421fd041e4775a0daa9a55e8b2ba5/users/59b3895a69584269bbc7f2bead5d2cac/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.744975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0c421fd041e4775a0daa9a55e8b2ba5, user_id=59b3895a69584269bbc7f2bead5d2cac, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:40.747709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:40.846401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1355/2676] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:40 2022] PUT /identity/v3/projects/e0c421fd041e4775a0daa9a55e8b2ba5/users/59b3895a69584269bbc7f2bead5d2cac/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:40.912196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb5bf-df08-4ef4-b1db-8a8007e0f7dc None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:40.912433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb5bf-df08-4ef4-b1db-8a8007e0f7dc None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:40.912719 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cdb5bf-df08-4ef4-b1db-8a8007e0f7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:40.942809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a1cdb5bf-df08-4ef4-b1db-8a8007e0f7dc None None] MFA Rules not processed for user `59b3895a69584269bbc7f2bead5d2cac`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:40.944025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a1cdb5bf-df08-4ef4-b1db-8a8007e0f7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:41.008797 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1322/2677] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:40 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:41.013345 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:41.084633 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47839d20-8a19-42f4-94fa-c345b58dff6d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:41.089942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:41.090583 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.091100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.091239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:41.091829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:41.094271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:41.227436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1356/2678] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:41 2022] POST /identity/v3/projects => generated 391 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:41.233100 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdb5bf-df08-4ef4-b1db-8a8007e0f7dc None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:41.244501 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cdb5bf-df08-4ef4-b1db-8a8007e0f7dc None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:41.318342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:41.319025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.319307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.319580 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:41.320318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:41.322504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:41.439599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1323/2679] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:41 2022] POST /identity/v3/users => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:41.441122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:41.451733 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a880d-7ae0-4e32-a616-1b0ddc430101 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:41.456970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:41.457576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.462691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.462691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:41.462691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:41.462691 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:41.472236 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1357/2680] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:08:41.476816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:41.487032 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9014-b839-45c1-9d7e-6bdbb26df06b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:41.491715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:41.492373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.492659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.492963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] PATH_INFO: `/v3/projects/625267d8991445e1ba72b821344b2d6e/users/67bb1de4fabf41058904667d5bb37ba7/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:41.509111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625267d8991445e1ba72b821344b2d6e, user_id=67bb1de4fabf41058904667d5bb37ba7, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:41.511834 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:41.643815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1324/2681] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:41 2022] PUT /identity/v3/projects/625267d8991445e1ba72b821344b2d6e/users/67bb1de4fabf41058904667d5bb37ba7/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:41.647919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:41.658445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d058f7-11b8-43b8-abc7-ea41eddeab31 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:41.680466 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:41.736908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ab0ad-6867-4842-8990-b3a284640b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:41.737615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab0ad-6867-4842-8990-b3a284640b89 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.737788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab0ad-6867-4842-8990-b3a284640b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.738076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ab0ad-6867-4842-8990-b3a284640b89 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:41.738703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ab0ad-6867-4842-8990-b3a284640b89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:41.740352 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ab0ad-6867-4842-8990-b3a284640b89 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:41.754006 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1358/2682] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:41.755202 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:41.761001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:41.767427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58332a1a-ee2f-48e5-8936-924357ea5f11 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:41.772736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:41.773413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.773698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.773976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] PATH_INFO: `/v3/projects/625267d8991445e1ba72b821344b2d6e/users/67bb1de4fabf41058904667d5bb37ba7/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:41.776143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=625267d8991445e1ba72b821344b2d6e, user_id=67bb1de4fabf41058904667d5bb37ba7, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:41.779011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:41.790035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1325/2683] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:41 2022] PUT /identity/v3/projects/625267d8991445e1ba72b821344b2d6e/users/67bb1de4fabf41058904667d5bb37ba7/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:41.800347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.808693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.808693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:41.830736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] MFA Rules not processed for user `67bb1de4fabf41058904667d5bb37ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:41.832070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:41.907071 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1359/2684] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:41 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:41.918129 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:41.923324 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:41.986914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932c6717-ae5a-403c-a7cf-d9465ee755d5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:41.991031 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:41.994903 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:41.994903 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:41.994903 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:42.002862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:42.004521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:42.015813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1326/2685] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:41 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:42.074558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:42.076167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:42.090752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed0c59-1e42-4553-8865-b829e0ddf98b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:42.098251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:42.098251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:42.098251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:42.098251 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:42.165980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:42.167540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:42.178153 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1360/2686] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:42 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:44.014051 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:44.016607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:44.089333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1102efb-ff8c-440d-8962-dae8d1e32cdf service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:44.094984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:44.095769 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:44.096116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:44.096465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] PATH_INFO: `/v3/users/65073017263e40358a97cc1dca7570ff` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:44.097726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] RBAC: Authorizing `identity:delete_user(user_id=65073017263e40358a97cc1dca7570ff)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:44.099773 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:44.385370 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65073017263e40358a97cc1dca7570ff'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:44.385968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65073017263e40358a97cc1dca7570ff'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:44.487181 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65073017263e40358a97cc1dca7570ff'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:44.501077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65073017263e40358a97cc1dca7570ff'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:44.509542 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c4175892-e37a-488f-a9d4-e53800fb509b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65073017263e40358a97cc1dca7570ff'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:44.518082 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1327/2687] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:44 2022] DELETE /identity/v3/users/65073017263e40358a97cc1dca7570ff => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:44.876262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:44.891635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a537853-aba3-4d42-81d9-9b275b6cae17 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:44.936719 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:44.952779 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:44.954180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:44.954458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:44.954732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] PATH_INFO: `/v3/projects/ce38c475e88945f4835b3d579da2f9fe` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:44.955915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce38c475e88945f4835b3d579da2f9fe)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:44.957867 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:45.117128 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce38c475e88945f4835b3d579da2f9fe', 'request_id': 'req-2d073119-3e44-4e40-b42b-f684b205db22'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:45.123386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce38c475e88945f4835b3d579da2f9fe', 'request_id': 'req-2d073119-3e44-4e40-b42b-f684b205db22'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:45.245311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce38c475e88945f4835b3d579da2f9fe', 'request_id': 'req-2d073119-3e44-4e40-b42b-f684b205db22'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:45.259181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] The token cache is being invalidate because project ce38c475e88945f4835b3d579da2f9fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:45.259476 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:45.260132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-2d073119-3e44-4e40-b42b-f684b205db22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:45.261651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1361/2688] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:44 2022] DELETE /identity/v3/projects/ce38c475e88945f4835b3d579da2f9fe => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:45.266611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d38d5-1b33-4e93-8152-3b58517724e2 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.267276 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d38d5-1b33-4e93-8152-3b58517724e2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.267685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d38d5-1b33-4e93-8152-3b58517724e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.289912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ae9d38d5-1b33-4e93-8152-3b58517724e2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:45.295517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ae9d38d5-1b33-4e93-8152-3b58517724e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:45.301563 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:45.356677 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1328/2689] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:08:45.365227 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9a45-4648-4569-bb10-ffbb1498ff0d None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.365593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9a45-4648-4569-bb10-ffbb1498ff0d None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.366124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5c9a45-4648-4569-bb10-ffbb1498ff0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.386169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-4f5c9a45-4648-4569-bb10-ffbb1498ff0d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:45.387437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-4f5c9a45-4648-4569-bb10-ffbb1498ff0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:45.395339 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1362/2690] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:45.399581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d38d5-1b33-4e93-8152-3b58517724e2 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:45.410018 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d38d5-1b33-4e93-8152-3b58517724e2 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:45.414481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:45.415114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.415396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.415670 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.416311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:45.416632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:45.418308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:45.431052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1329/2691] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:08:45.435889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9a45-4648-4569-bb10-ffbb1498ff0d None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:45.445773 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5c9a45-4648-4569-bb10-ffbb1498ff0d None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:45.450622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:45.451254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.451561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.451802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.452440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:45.454360 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:45.568436 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1363/2692] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:45 2022] POST /identity/v3/projects => generated 387 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:45.572980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:45.582922 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c961211-daa4-414e-a8ab-7d719c679b2d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:45.641745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:45.642389 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.642671 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.642980 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.643622 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:45.645533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:45.757709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1330/2693] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:45 2022] POST /identity/v3/users => generated 294 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:45.761959 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:45.773018 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3435d-3fe6-43c4-abca-b66167524ca5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:45.777967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:45.778574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.778895 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.779171 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.779882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:45.782129 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:45.792136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1364/2694] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:45.796133 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:45.806655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f732ee72-647e-4437-b129-7432ef48d60b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:45.811372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cad536-b1d5-4105-b1b7-d7d3adb665df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:45.811968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad536-b1d5-4105-b1b7-d7d3adb665df admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.812254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad536-b1d5-4105-b1b7-d7d3adb665df admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.812533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cad536-b1d5-4105-b1b7-d7d3adb665df admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.813213 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cad536-b1d5-4105-b1b7-d7d3adb665df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:45.815664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cad536-b1d5-4105-b1b7-d7d3adb665df admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:45.829200 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1331/2695] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:45.833503 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:45.845837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4334be-e1a1-4471-baee-c10e6b5d6b65 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:45.850930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:45.851618 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.851908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.852184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] PATH_INFO: `/v3/projects/cf7f152e451c46169aae4272cf429055/users/ec51f4904ca6488fac438ac024a6fb58/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:45.868313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf7f152e451c46169aae4272cf429055, user_id=ec51f4904ca6488fac438ac024a6fb58, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:45.871015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:45.971709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1365/2696] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:45 2022] PUT /identity/v3/projects/cf7f152e451c46169aae4272cf429055/users/ec51f4904ca6488fac438ac024a6fb58/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:45.983692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82f76-ffd4-4383-8d3c-d41d2fc095b6 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:45.983692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82f76-ffd4-4383-8d3c-d41d2fc095b6 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:45.983692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d82f76-ffd4-4383-8d3c-d41d2fc095b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.011118 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-95d82f76-ffd4-4383-8d3c-d41d2fc095b6 None None] MFA Rules not processed for user `ec51f4904ca6488fac438ac024a6fb58`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:46.012368 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-95d82f76-ffd4-4383-8d3c-d41d2fc095b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:46.079420 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1332/2697] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:46.083978 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:46.147122 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d20a46-56a3-4f6d-83e2-b8c4f5e20197 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:46.152162 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:46.152771 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:46.153057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:46.153336 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.154076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:46.156010 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:46.171570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:46.304183 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1366/2698] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:46 2022] POST /identity/v3/projects => generated 385 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:46.308315 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82f76-ffd4-4383-8d3c-d41d2fc095b6 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:46.319609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d82f76-ffd4-4383-8d3c-d41d2fc095b6 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:46.323447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:46.378189 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:46.378835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:46.379121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:46.382264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.382264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:46.382264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:46.497313 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1333/2699] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:46 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:08:46.502233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:46.512739 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616276a8-e84a-4bca-8153-47d61da6da4f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:46.518600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:46.519395 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:46.519764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:46.520124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.520785 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:46.522448 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:46.537323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1367/2700] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:46.539432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:46.550204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2d763e-ef62-4860-9271-dc2e5db17e8b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:46.555066 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:46.555678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:46.555966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:46.556250 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] PATH_INFO: `/v3/projects/0c17b5dc4afb4d70b737d225c026b83b/users/f8352242f0d94645991002a31b453f87/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.573692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c17b5dc4afb4d70b737d225c026b83b, user_id=f8352242f0d94645991002a31b453f87, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:46.577230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:46.726758 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1334/2701] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:46 2022] PUT /identity/v3/projects/0c17b5dc4afb4d70b737d225c026b83b/users/f8352242f0d94645991002a31b453f87/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:46.732946 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:46.751755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e7b4be-d3c9-4678-aa54-3d27702aeeb6 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:46.812430 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366fc51-c829-440d-b4f2-1bddadacc859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:46.813442 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fc51-c829-440d-b4f2-1bddadacc859 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:46.813729 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fc51-c829-440d-b4f2-1bddadacc859 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:46.814037 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366fc51-c829-440d-b4f2-1bddadacc859 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.814683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366fc51-c829-440d-b4f2-1bddadacc859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:46.816302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366fc51-c829-440d-b4f2-1bddadacc859 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:46.827022 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1368/2702] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:46.831285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:46.841976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626697e8-d0ea-4a2b-ab4e-b494ff9473ff admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:46.847599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:46.848259 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:46.848546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:46.848819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] PATH_INFO: `/v3/projects/0c17b5dc4afb4d70b737d225c026b83b/users/f8352242f0d94645991002a31b453f87/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.850736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c17b5dc4afb4d70b737d225c026b83b, user_id=f8352242f0d94645991002a31b453f87, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:46.853474 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:46.865597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1335/2703] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:46 2022] PUT /identity/v3/projects/0c17b5dc4afb4d70b737d225c026b83b/users/f8352242f0d94645991002a31b453f87/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:46.877386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9654-05e6-44ec-9458-2ac05913d5aa None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:46.877700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9654-05e6-44ec-9458-2ac05913d5aa None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:46.878032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27b9654-05e6-44ec-9458-2ac05913d5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:46.911588 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-c27b9654-05e6-44ec-9458-2ac05913d5aa None None] MFA Rules not processed for user `f8352242f0d94645991002a31b453f87`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:46.912825 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c27b9654-05e6-44ec-9458-2ac05913d5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:46.985479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1369/2704] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:46 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:46.999577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:47.001546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:47.065081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040d7b-f01b-44f4-b37b-d793ef7091a3 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:47.069305 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef77ec9-c3b0-45a2-80b9-287f75b28d28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:47.070001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef77ec9-c3b0-45a2-80b9-287f75b28d28 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:47.070243 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef77ec9-c3b0-45a2-80b9-287f75b28d28 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:47.070794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef77ec9-c3b0-45a2-80b9-287f75b28d28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:47.081309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef77ec9-c3b0-45a2-80b9-287f75b28d28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:47.082865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef77ec9-c3b0-45a2-80b9-287f75b28d28 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:47.093727 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1336/2705] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:08:47.162117 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b9654-05e6-44ec-9458-2ac05913d5aa None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:47.233666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27b9654-05e6-44ec-9458-2ac05913d5aa None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:47.239254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:47.240098 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:47.240386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:47.240668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] PATH_INFO: `/v3/users/ec51f4904ca6488fac438ac024a6fb58` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:47.241914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec51f4904ca6488fac438ac024a6fb58)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:47.243888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:47.252437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:47.506668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec51f4904ca6488fac438ac024a6fb58'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:47.507294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec51f4904ca6488fac438ac024a6fb58'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:47.618313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec51f4904ca6488fac438ac024a6fb58'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:47.625697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec51f4904ca6488fac438ac024a6fb58'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:47.637194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec51f4904ca6488fac438ac024a6fb58'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:47.643034 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1370/2706] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:47 2022] DELETE /identity/v3/users/ec51f4904ca6488fac438ac024a6fb58 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:47.647561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9886-f531-4d07-b900-5619dc132150 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:47.648046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9886-f531-4d07-b900-5619dc132150 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:47.648156 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565f9886-f531-4d07-b900-5619dc132150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:47.667781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-565f9886-f531-4d07-b900-5619dc132150 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:47.669057 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-565f9886-f531-4d07-b900-5619dc132150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:47.701480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:47.703123 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:47.741017 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1337/2707] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:47.751330 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9886-f531-4d07-b900-5619dc132150 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:47.752783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-565f9886-f531-4d07-b900-5619dc132150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:47.758152 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:47.781969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea9ccba-ff98-4a43-9aaf-1a328c982284 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:47.787815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:47.788480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:47.788764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:47.789043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] PATH_INFO: `/v3/users/59b3895a69584269bbc7f2bead5d2cac` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:47.790225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b3895a69584269bbc7f2bead5d2cac)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:47.792440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:47.814798 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565f9886-f531-4d07-b900-5619dc132150 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:47.818650 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364994c6-3ed4-4f37-b4cf-21b0ffca89a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:47.819296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364994c6-3ed4-4f37-b4cf-21b0ffca89a3 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:47.819632 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364994c6-3ed4-4f37-b4cf-21b0ffca89a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:47.819914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364994c6-3ed4-4f37-b4cf-21b0ffca89a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:47.829531 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364994c6-3ed4-4f37-b4cf-21b0ffca89a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:47.831395 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364994c6-3ed4-4f37-b4cf-21b0ffca89a3 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:47.840932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1338/2708] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:08:48.020443 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b3895a69584269bbc7f2bead5d2cac'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.021052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b3895a69584269bbc7f2bead5d2cac'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.115986 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b3895a69584269bbc7f2bead5d2cac'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.124130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b3895a69584269bbc7f2bead5d2cac'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.139050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b3895a69584269bbc7f2bead5d2cac'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.145925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1371/2709] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:47 2022] DELETE /identity/v3/users/59b3895a69584269bbc7f2bead5d2cac => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:48.150654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:48.151122 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:48.151410 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:48.170512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:48.172299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:48.234048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1339/2710] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:48.244343 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:48.249181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:48.252215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:48.301823 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7bac89-7ae0-4d87-a859-f4f1bda935c4 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:48.305479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:48.306086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:48.306373 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:48.306653 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:48.316243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:48.317680 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:48.323787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:48.325611 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:48.328520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1372/2711] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:48.339052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ef65b-db86-441b-b482-2e8203b41bff None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:48.346914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:48.347652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:48.348005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:48.348441 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] PATH_INFO: `/v3/projects/cf7f152e451c46169aae4272cf429055` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:48.349676 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf7f152e451c46169aae4272cf429055)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:48.351704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:48.494353 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf7f152e451c46169aae4272cf429055', 'request_id': 'req-6a5603dc-37e5-4b3b-8342-9dd7d727f219'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.500540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf7f152e451c46169aae4272cf429055', 'request_id': 'req-6a5603dc-37e5-4b3b-8342-9dd7d727f219'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.506343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf7f152e451c46169aae4272cf429055', 'request_id': 'req-6a5603dc-37e5-4b3b-8342-9dd7d727f219'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.614117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] The token cache is being invalidate because project cf7f152e451c46169aae4272cf429055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:48.614439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.615126 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:48.616725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1340/2712] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:48 2022] DELETE /identity/v3/projects/cf7f152e451c46169aae4272cf429055 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:48.620822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:48.631228 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08679344-750d-4259-8a8f-06f4593d14c6 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:48.688672 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:48.689310 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:48.689592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:48.689870 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] PATH_INFO: `/v3/users/f8352242f0d94645991002a31b453f87` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:48.691013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8352242f0d94645991002a31b453f87)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:48.692950 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:48.814161 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:48.815782 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:48.829556 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5603dc-37e5-4b3b-8342-9dd7d727f219 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:48.834301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:48.834977 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:48.835306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:48.835513 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] PATH_INFO: `/v3/projects/e0c421fd041e4775a0daa9a55e8b2ba5` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:48.836649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0c421fd041e4775a0daa9a55e8b2ba5)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:48.838614 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:48.864326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:49.010400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8352242f0d94645991002a31b453f87'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.011078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8352242f0d94645991002a31b453f87'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.014371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0c421fd041e4775a0daa9a55e8b2ba5', 'request_id': 'req-f1298570-687f-47bc-9270-871ca722286d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.020599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0c421fd041e4775a0daa9a55e8b2ba5', 'request_id': 'req-f1298570-687f-47bc-9270-871ca722286d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.027593 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0c421fd041e4775a0daa9a55e8b2ba5', 'request_id': 'req-f1298570-687f-47bc-9270-871ca722286d'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.173239 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8352242f0d94645991002a31b453f87'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.180762 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8352242f0d94645991002a31b453f87'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.192450 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8352242f0d94645991002a31b453f87'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.198564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1373/2713] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:48 2022] DELETE /identity/v3/users/f8352242f0d94645991002a31b453f87 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:49.321708 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] The token cache is being invalidate because project e0c421fd041e4775a0daa9a55e8b2ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:49.323155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.323155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.324206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1341/2714] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:48 2022] DELETE /identity/v3/projects/e0c421fd041e4775a0daa9a55e8b2ba5 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:49.328483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:49.329903 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:49.360509 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:49.392480 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43db91d-937c-4bb2-84d4-3879843ed886 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:49.397081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:49.397704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:49.397988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:49.398262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] PATH_INFO: `/v3/users/67bb1de4fabf41058904667d5bb37ba7` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:49.399413 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] RBAC: Authorizing `identity:delete_user(user_id=67bb1de4fabf41058904667d5bb37ba7)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:49.401326 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:49.638799 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67bb1de4fabf41058904667d5bb37ba7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.639696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67bb1de4fabf41058904667d5bb37ba7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.707902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:49.709413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:49.744323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67bb1de4fabf41058904667d5bb37ba7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.754147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67bb1de4fabf41058904667d5bb37ba7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.767518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-308c1839-dfce-48c4-8bfe-1aa64735144c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67bb1de4fabf41058904667d5bb37ba7'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.774279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1374/2715] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:49 2022] DELETE /identity/v3/users/67bb1de4fabf41058904667d5bb37ba7 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:49.794533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1298570-687f-47bc-9270-871ca722286d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:49.851892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:49.852943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:49.852943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:49.853268 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] PATH_INFO: `/v3/projects/0c17b5dc4afb4d70b737d225c026b83b` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:49.854193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c17b5dc4afb4d70b737d225c026b83b)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:49.856136 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:49.980263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c17b5dc4afb4d70b737d225c026b83b', 'request_id': 'req-2d3b4e46-ce63-4370-9375-664038834244'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.988582 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c17b5dc4afb4d70b737d225c026b83b', 'request_id': 'req-2d3b4e46-ce63-4370-9375-664038834244'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:49.994321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:49.995699 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c17b5dc4afb4d70b737d225c026b83b', 'request_id': 'req-2d3b4e46-ce63-4370-9375-664038834244'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.102880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] The token cache is being invalidate because project 0c17b5dc4afb4d70b737d225c026b83b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:50.103123 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.108835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-2d3b4e46-ce63-4370-9375-664038834244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.108835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1342/2716] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:49 2022] DELETE /identity/v3/projects/0c17b5dc4afb4d70b737d225c026b83b => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:50.110984 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c843-2303-4cd6-886b-6b1c901ea23c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.111142 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c843-2303-4cd6-886b-6b1c901ea23c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.111419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833c843-2303-4cd6-886b-6b1c901ea23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.131498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f833c843-2303-4cd6-886b-6b1c901ea23c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:50.132722 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f833c843-2303-4cd6-886b-6b1c901ea23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:50.193274 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1375/2717] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:50.201460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.201780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.202063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.226227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:50.226227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:50.232799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1343/2718] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:50.237897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833c843-2303-4cd6-886b-6b1c901ea23c None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.247732 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833c843-2303-4cd6-886b-6b1c901ea23c None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.255328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.255328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.255328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.255328 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.255668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:50.255668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.257065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.260047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.261710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:50.273877 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1376/2719] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:08:50.276243 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.280880 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74f9999-eec4-45fe-be70-5e47799e14ca None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.286049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.286701 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.287281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.287565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] PATH_INFO: `/v3/projects/625267d8991445e1ba72b821344b2d6e` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.288745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=625267d8991445e1ba72b821344b2d6e)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.288966 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4e9e12-1a26-4415-a890-14bb97c164fe admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.290710 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.293846 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.294463 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.294745 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.295099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.295736 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.298531 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.499271 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1377/2720] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/projects => generated 379 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:50.503790 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.510343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '625267d8991445e1ba72b821344b2d6e', 'request_id': 'req-35774eb8-4b04-4584-9105-a7623c6d6533'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.517697 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '625267d8991445e1ba72b821344b2d6e', 'request_id': 'req-35774eb8-4b04-4584-9105-a7623c6d6533'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.518548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:50.523826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '625267d8991445e1ba72b821344b2d6e', 'request_id': 'req-35774eb8-4b04-4584-9105-a7623c6d6533'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.568569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fbe17e-25c7-4ee6-a5a0-4766dc9cad2d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.573632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.574248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.574537 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.574856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.575490 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.577419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.692398 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] The token cache is being invalidate because project 625267d8991445e1ba72b821344b2d6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:50.694828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.694828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-35774eb8-4b04-4584-9105-a7623c6d6533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:50.695111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1378/2721] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/users => generated 290 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:08:50.697532 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1344/2722] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:50 2022] DELETE /identity/v3/projects/625267d8991445e1ba72b821344b2d6e => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:50.698510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.700353 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:50.700862 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999c4c-e876-4ef3-8f34-12b86dd45f71 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.701343 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999c4c-e876-4ef3-8f34-12b86dd45f71 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.701731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb999c4c-e876-4ef3-8f34-12b86dd45f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.712985 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8bb20-64e4-4233-9e8e-052939d36ca3 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.717962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.719094 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.719400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.719674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.720457 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.722108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.723803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-eb999c4c-e876-4ef3-8f34-12b86dd45f71 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:50.725433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-eb999c4c-e876-4ef3-8f34-12b86dd45f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:50.736746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1379/2723] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:50.736936 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1345/2724] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:08:50.738004 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.743182 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2cb9-c074-41d8-8d4c-ec1fd760634d None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.743546 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2cb9-c074-41d8-8d4c-ec1fd760634d None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.743681 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9d2cb9-c074-41d8-8d4c-ec1fd760634d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.748407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9e74f-4764-4706-b708-09c4215d62d5 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.753791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.754327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.754607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.754924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.755571 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.757159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.763033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-be9d2cb9-c074-41d8-8d4c-ec1fd760634d None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:50.764249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-be9d2cb9-c074-41d8-8d4c-ec1fd760634d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:50.767802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1380/2725] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:50.771948 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.773103 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1346/2726] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:08:50.777682 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d2cb9-c074-41d8-8d4c-ec1fd760634d None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.783226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2350-d0be-4315-b492-d5159cf923a1 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.787930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9d2cb9-c074-41d8-8d4c-ec1fd760634d None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.788063 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a5a558-538c-4d6d-9744-ad38a8f105f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.788695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a558-538c-4d6d-9744-ad38a8f105f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.788976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a558-538c-4d6d-9744-ad38a8f105f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.789252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a5a558-538c-4d6d-9744-ad38a8f105f8 admin admin] PATH_INFO: `/v3/projects/b693d65347df4d788ca23ebcbcfc166d/users/b2222c86e2794e1f813b97eb816c0773/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.793149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.793795 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.794081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.794358 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.795049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:50.795355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.797620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.806961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a558-538c-4d6d-9744-ad38a8f105f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b693d65347df4d788ca23ebcbcfc166d, user_id=b2222c86e2794e1f813b97eb816c0773, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.809615 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a5a558-538c-4d6d-9744-ad38a8f105f8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.810717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1347/2727] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:08:50.815510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:50.826026 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85925a74-85a6-43fb-a969-5cad2ed0d558 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:50.830824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:50.831423 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.831704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.831978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.832602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:50.834646 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:50.899170 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1381/2728] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:50 2022] PUT /identity/v3/projects/b693d65347df4d788ca23ebcbcfc166d/users/b2222c86e2794e1f813b97eb816c0773/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:50.911898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08445-a665-4f36-b73e-b1f4432cd49e None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:50.912295 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08445-a665-4f36-b73e-b1f4432cd49e None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:50.912489 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f08445-a665-4f36-b73e-b1f4432cd49e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:50.941526 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1348/2729] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/projects => generated 409 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:50.942685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f9f08445-a665-4f36-b73e-b1f4432cd49e None None] MFA Rules not processed for user `b2222c86e2794e1f813b97eb816c0773`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:50.943930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f9f08445-a665-4f36-b73e-b1f4432cd49e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:50.948806 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.011998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1382/2730] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:08:51.016838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f08445-a665-4f36-b73e-b1f4432cd49e None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.018000 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa280cb-9ece-4fe0-8238-23b606a16a9a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.024487 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.025378 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.025864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.026289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.027300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.028121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f08445-a665-4f36-b73e-b1f4432cd49e None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.029861 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.034909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.035637 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.036020 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.036402 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.037223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.039440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.155759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1349/2731] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:50 2022] POST /identity/v3/users => generated 305 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:08:51.160433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.170199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd63183-8192-4ada-ae20-b927a1853917 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.174921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.179230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.179230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.179230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.179230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.179230 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.179853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=86,keystone:INSERT=6,keystone:DELETE=8 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:51.187405 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1383/2732] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:51 2022] POST /identity/v3/projects => generated 381 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:08:51.188468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.189892 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1350/2733] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:08:51.193606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.204851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf49e4-8cf7-43b9-ab70-e97ea8c987d9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.215404 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:51.255279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adbec81-60bb-4ee1-bbca-68f200635d1b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.259854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.260553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.260780 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.261058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.262049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.262160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.262483 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.263052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.263052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.263685 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.263802 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.265750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.276539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1351/2734] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:08:51.282569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.291193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7849ea2-3ce6-4b5e-8547-abed5e64e965 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.295968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01835d0-a13b-41d3-aa51-92eee2ec25b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.296656 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01835d0-a13b-41d3-aa51-92eee2ec25b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.296943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01835d0-a13b-41d3-aa51-92eee2ec25b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.297223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01835d0-a13b-41d3-aa51-92eee2ec25b6 admin admin] PATH_INFO: `/v3/projects/460eedf2648d4ce0a5ca9aabfdb5ebec/users/afefe153ae4f4b5b8678f636275abde0/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.313965 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01835d0-a13b-41d3-aa51-92eee2ec25b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=460eedf2648d4ce0a5ca9aabfdb5ebec, user_id=afefe153ae4f4b5b8678f636275abde0, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.316716 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01835d0-a13b-41d3-aa51-92eee2ec25b6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.367925 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1384/2735] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:51 2022] POST /identity/v3/users => generated 297 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:51.371741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.382050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10be5eab-404d-43a4-b12e-5c8fb05abf2a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.386789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.387386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.387669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.387951 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.388906 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.391225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.397263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1352/2736] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:51 2022] PUT /identity/v3/projects/460eedf2648d4ce0a5ca9aabfdb5ebec/users/afefe153ae4f4b5b8678f636275abde0/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:51.410091 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1385/2737] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:08:51.411673 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676bc3-9552-4bd5-94dd-75b0ebce6aa2 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.412104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676bc3-9552-4bd5-94dd-75b0ebce6aa2 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.412482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676bc3-9552-4bd5-94dd-75b0ebce6aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.413073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.423424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37aa60-a787-4fc8-8141-1ddf155f4433 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.443242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-9b676bc3-9552-4bd5-94dd-75b0ebce6aa2 None None] MFA Rules not processed for user `afefe153ae4f4b5b8678f636275abde0`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:51.444475 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-9b676bc3-9552-4bd5-94dd-75b0ebce6aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:51.481082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.481743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.482028 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.482313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] PATH_INFO: `/v3/projects/670c57e5befd4d2eb1eb89e0d9193439/users/bea739160016475ab769437c123c00d6/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.504370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=670c57e5befd4d2eb1eb89e0d9193439, user_id=bea739160016475ab769437c123c00d6, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.509799 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1353/2738] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:51.509921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.513500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676bc3-9552-4bd5-94dd-75b0ebce6aa2 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.525058 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676bc3-9552-4bd5-94dd-75b0ebce6aa2 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.530071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.530723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.531176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.532289 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.533041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.535110 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.613275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1386/2739] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:51 2022] PUT /identity/v3/projects/670c57e5befd4d2eb1eb89e0d9193439/users/bea739160016475ab769437c123c00d6/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:51.617146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.661053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1354/2740] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:51 2022] POST /identity/v3/projects => generated 405 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:08:51.665113 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.685277 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f58ad13-e494-4603-83d9-d91f0db60051 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.713079 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:51.716971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:51.742183 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb5f34-c0ee-4792-9f21-f5cd0e205632 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.746419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.746788 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.747065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.747351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.747454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.747635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.747827 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.748072 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.748273 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.748613 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.749866 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.750535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.760163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1387/2741] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:08:51.764397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.774714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99038b3e-f441-49f2-95e2-40618a3d3c4d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.779521 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46316ad-2578-426e-b752-ea3be7f29c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.780169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46316ad-2578-426e-b752-ea3be7f29c6b admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.780454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46316ad-2578-426e-b752-ea3be7f29c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.780734 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46316ad-2578-426e-b752-ea3be7f29c6b admin admin] PATH_INFO: `/v3/projects/670c57e5befd4d2eb1eb89e0d9193439/users/bea739160016475ab769437c123c00d6/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.783524 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46316ad-2578-426e-b752-ea3be7f29c6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=670c57e5befd4d2eb1eb89e0d9193439, user_id=bea739160016475ab769437c123c00d6, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.786155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46316ad-2578-426e-b752-ea3be7f29c6b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.796237 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1388/2742] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:51 2022] PUT /identity/v3/projects/670c57e5befd4d2eb1eb89e0d9193439/users/bea739160016475ab769437c123c00d6/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:51.808375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.808661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.808937 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.836681 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] MFA Rules not processed for user `bea739160016475ab769437c123c00d6`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:51.837914 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:51.900540 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1355/2743] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:51 2022] POST /identity/v3/users => generated 309 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:51.903748 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.914332 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1389/2744] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:51.915209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0cb601-c9e5-427d-b2b4-88a8e0b69d2b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.922354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.923749 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:51.975987 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.976601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.976870 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.977142 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.977814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.979493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:51.981875 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86d61-a74f-4be6-adb8-66f6423a7382 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:51.985901 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:51.986525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:51.986840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:51.987126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:51.989960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1356/2745] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:51.994039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:51.997519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:51.999001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:52.004088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680d947-274e-4e32-a431-1486f43aa636 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:52.008457 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:52.009104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:52.009388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:52.009610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1390/2746] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:08:52.009761 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] PATH_INFO: `/v3/projects/8d6ae7abb6604a7eaad5127ee4ca46ef/users/0641f507ec004bf88fe05cd3270df1c5/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:52.025500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6ae7abb6604a7eaad5127ee4ca46ef, user_id=0641f507ec004bf88fe05cd3270df1c5, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:52.028201 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:52.099555 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1357/2747] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:51 2022] PUT /identity/v3/projects/8d6ae7abb6604a7eaad5127ee4ca46ef/users/0641f507ec004bf88fe05cd3270df1c5/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:52.110136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:52.120696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f843ff0-2607-4d0a-9e64-fa200880fa65 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:52.162144 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:52.177820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc865d3-664f-4ed8-8c5b-36b4f3468b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:52.178427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc865d3-664f-4ed8-8c5b-36b4f3468b5d admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:52.178712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc865d3-664f-4ed8-8c5b-36b4f3468b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:52.179027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc865d3-664f-4ed8-8c5b-36b4f3468b5d admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:52.179706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc865d3-664f-4ed8-8c5b-36b4f3468b5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:52.181306 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc865d3-664f-4ed8-8c5b-36b4f3468b5d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:52.192040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1391/2748] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:52.196725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:52.207813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e98cb-7715-47e7-836f-40e9a38dc7f9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:52.212505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:52.213160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:52.213481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:52.213764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] PATH_INFO: `/v3/projects/8d6ae7abb6604a7eaad5127ee4ca46ef/users/0641f507ec004bf88fe05cd3270df1c5/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:52.215813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d6ae7abb6604a7eaad5127ee4ca46ef, user_id=0641f507ec004bf88fe05cd3270df1c5, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:52.218550 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:52.229725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1358/2749] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:52 2022] PUT /identity/v3/projects/8d6ae7abb6604a7eaad5127ee4ca46ef/users/0641f507ec004bf88fe05cd3270df1c5/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:52.239971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056531-983e-4569-b140-10660133fa2b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:52.240523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056531-983e-4569-b140-10660133fa2b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:52.240523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d056531-983e-4569-b140-10660133fa2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:52.271824 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-6d056531-983e-4569-b140-10660133fa2b None None] MFA Rules not processed for user `0641f507ec004bf88fe05cd3270df1c5`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:52.273125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-6d056531-983e-4569-b140-10660133fa2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:52.343881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1392/2750] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:52 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:52.354373 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:52.410056 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b5a40-b60c-4e30-a5a0-b0aa0e36918a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:52.414120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:52.414731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:52.415037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:52.415308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:52.424597 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:52.426087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:52.435426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1359/2751] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:52 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:52.922668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056531-983e-4569-b140-10660133fa2b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:52.933073 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d056531-983e-4569-b140-10660133fa2b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:52.938040 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:52.938682 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:52.938998 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:52.939276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:52.999518 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:53.000924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:53.013508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1393/2752] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:52 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:53.209369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:53.239306 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:53.272260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e98eb1-ed50-4f43-8a57-ff3f1db1f9c4 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:53.277221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea739160016475ab769437c123c00d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670c57e5befd4d2eb1eb89e0d9193439', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:53.277872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:53.278163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:53.278471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:53.279188 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:53.279517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:53.281833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:53.298535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1360/2753] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:08:53.303159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:53.313991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908a60-5868-4f91-846f-0b852566bd89 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:53.324881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea739160016475ab769437c123c00d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670c57e5befd4d2eb1eb89e0d9193439', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:53.325515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:53.327076 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:53.327374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:53.328683 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:53.330744 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:53.494374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1394/2754] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:53 2022] POST /identity/v3/projects => generated 354 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:53.498851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:53.508899 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1ee696-cf62-4d7a-81c1-3624be4ac0d5 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:53.571704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea739160016475ab769437c123c00d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670c57e5befd4d2eb1eb89e0d9193439', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:53.572318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:53.572608 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:53.572894 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:53.573552 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:53.573865 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:53.575509 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:53.587817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1361/2755] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:08:53.630176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:53.641813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266008c-e29e-4606-9bb0-2a2f8cd04611 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:53.647258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bea739160016475ab769437c123c00d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '670c57e5befd4d2eb1eb89e0d9193439', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:53.647897 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:53.648186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:53.648467 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] PATH_INFO: `/v3/projects/0e427a3794ea4733a3cfcf380a616d78` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:53.649612 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0e427a3794ea4733a3cfcf380a616d78)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:53.651604 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:53.764219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:53.781441 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e427a3794ea4733a3cfcf380a616d78', 'request_id': 'req-de53ebf3-9b83-42d3-997b-df8c6081bfe9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:53.787435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e427a3794ea4733a3cfcf380a616d78', 'request_id': 'req-de53ebf3-9b83-42d3-997b-df8c6081bfe9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:53.880899 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e427a3794ea4733a3cfcf380a616d78', 'request_id': 'req-de53ebf3-9b83-42d3-997b-df8c6081bfe9'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:53.893704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] The token cache is being invalidate because project 0e427a3794ea4733a3cfcf380a616d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:53.894001 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:53.894666 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-de53ebf3-9b83-42d3-997b-df8c6081bfe9 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:53.896244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1395/2756] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:53 2022] DELETE /identity/v3/projects/0e427a3794ea4733a3cfcf380a616d78 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:54.734090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:54.735877 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:54.804672 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285ea03-2905-4679-a7d5-45215d5f6df2 tempest-VolumeQuotaClassesTest-1883965044 tempest-VolumeQuotaClassesTest-1883965044-project-admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:54.863968 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:54.864617 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:54.864900 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:54.865178 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] PATH_INFO: `/v3/users/b2222c86e2794e1f813b97eb816c0773` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:54.867059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2222c86e2794e1f813b97eb816c0773)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:54.869568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:54.872194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=100 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:55.064949 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2222c86e2794e1f813b97eb816c0773'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:55.065534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2222c86e2794e1f813b97eb816c0773'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:55.247005 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2222c86e2794e1f813b97eb816c0773'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:55.260221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2222c86e2794e1f813b97eb816c0773'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:55.273163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2222c86e2794e1f813b97eb816c0773'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:55.280074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1362/2757] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:54 2022] DELETE /identity/v3/users/b2222c86e2794e1f813b97eb816c0773 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:55.285061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:55.285532 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:55.285631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:55.304957 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:55.306200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:55.366797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1396/2758] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:55.376700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:55.378240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:55.436723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe9e74b-f206-4d85-99f2-7e5db5120205 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:55.440637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:55.441282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:55.441573 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:55.441851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:55.451302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:55.453272 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:55.462856 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1363/2759] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:08:55.991283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:55.991536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:56.004197 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e3ca70-a8dc-4800-ad6e-9ef1f4ac0888 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:56.009458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:56.010100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:56.010382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:56.010661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] PATH_INFO: `/v3/projects/b693d65347df4d788ca23ebcbcfc166d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:56.011874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b693d65347df4d788ca23ebcbcfc166d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:56.013916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:56.224713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b693d65347df4d788ca23ebcbcfc166d', 'request_id': 'req-d0eeec8d-59f9-496d-85c6-f15d1f72659b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.230407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b693d65347df4d788ca23ebcbcfc166d', 'request_id': 'req-d0eeec8d-59f9-496d-85c6-f15d1f72659b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.389530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b693d65347df4d788ca23ebcbcfc166d', 'request_id': 'req-d0eeec8d-59f9-496d-85c6-f15d1f72659b'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.401820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] The token cache is being invalidate because project b693d65347df4d788ca23ebcbcfc166d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:56.402111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.402781 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.404288 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1397/2760] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:55 2022] DELETE /identity/v3/projects/b693d65347df4d788ca23ebcbcfc166d => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:56.409345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:56.424872 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8afe84-5fac-4b6e-892c-81d84d7934bf service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:56.483618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:56.484247 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:56.484529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:56.484820 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] PATH_INFO: `/v3/users/bea739160016475ab769437c123c00d6` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:56.485946 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea739160016475ab769437c123c00d6)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:56.487910 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:56.629460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:56.771538 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea739160016475ab769437c123c00d6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.772577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea739160016475ab769437c123c00d6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.881601 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea739160016475ab769437c123c00d6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.896006 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea739160016475ab769437c123c00d6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.903734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7ff4bfa5-7800-4495-a928-d4eaf891535e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea739160016475ab769437c123c00d6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:56.910819 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1364/2761] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:08:56 2022] DELETE /identity/v3/users/bea739160016475ab769437c123c00d6 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:08:57.472280 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:57.474557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:57.499437 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0eeec8d-59f9-496d-85c6-f15d1f72659b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:57.547942 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:57.560559 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:57.561191 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:57.561473 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:57.561756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] PATH_INFO: `/v3/projects/670c57e5befd4d2eb1eb89e0d9193439` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:57.563827 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=670c57e5befd4d2eb1eb89e0d9193439)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:57.565730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:57.727159 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '670c57e5befd4d2eb1eb89e0d9193439', 'request_id': 'req-181394da-654c-4282-ba6a-5b9c1939c5fb'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:57.732564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '670c57e5befd4d2eb1eb89e0d9193439', 'request_id': 'req-181394da-654c-4282-ba6a-5b9c1939c5fb'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:57.816459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '670c57e5befd4d2eb1eb89e0d9193439', 'request_id': 'req-181394da-654c-4282-ba6a-5b9c1939c5fb'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:57.828469 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] The token cache is being invalidate because project 670c57e5befd4d2eb1eb89e0d9193439 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:08:57.828762 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:57.829399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-181394da-654c-4282-ba6a-5b9c1939c5fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:08:57.830913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1398/2762] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:08:57 2022] DELETE /identity/v3/projects/670c57e5befd4d2eb1eb89e0d9193439 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:57.836039 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74f713-de44-4ba2-a1e4-8dfe069dfa04 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:57.836529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74f713-de44-4ba2-a1e4-8dfe069dfa04 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:57.836625 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e74f713-de44-4ba2-a1e4-8dfe069dfa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:57.863345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-7e74f713-de44-4ba2-a1e4-8dfe069dfa04 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:57.864575 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-7e74f713-de44-4ba2-a1e4-8dfe069dfa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:57.925661 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1365/2763] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:57.934093 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ea4f-e957-4339-a1b7-948a925fc9a2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:57.934399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ea4f-e957-4339-a1b7-948a925fc9a2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:57.934679 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de97ea4f-e957-4339-a1b7-948a925fc9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:57.955552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-de97ea4f-e957-4339-a1b7-948a925fc9a2 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:57.956783 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-de97ea4f-e957-4339-a1b7-948a925fc9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:57.964975 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1399/2764] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:57.969415 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74f713-de44-4ba2-a1e4-8dfe069dfa04 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:57.980649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e74f713-de44-4ba2-a1e4-8dfe069dfa04 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:57.986120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:57.986725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:57.987046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:57.987323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:57.988049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:08:57.988360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:57.989961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:58.002318 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1366/2765] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:08:58.006909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ea4f-e957-4339-a1b7-948a925fc9a2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:58.016393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de97ea4f-e957-4339-a1b7-948a925fc9a2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:58.021146 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:58.021759 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.022043 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.022323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.022991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:58.024907 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:58.145882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1400/2766] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:58 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:58.150046 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:58.160600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e213e1a-eca8-44bf-a030-4205b0846df9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:58.216578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:58.217223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.217505 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.217777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.218969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:58.220902 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:58.314157 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1367/2767] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:58 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:58.318407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:58.329179 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae31c239-96eb-4b93-906c-a0f6b65e7f8b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:58.333830 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:58.334468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.334750 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.335059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.335703 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:58.337358 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:58.348262 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1401/2768] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:58.352397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:58.363235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cf1cb-67a8-45a1-90e0-9e8beff3522b admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:58.367952 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e60ff-3905-45b9-9e21-00ccac5a3a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:58.368554 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e60ff-3905-45b9-9e21-00ccac5a3a40 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.368839 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e60ff-3905-45b9-9e21-00ccac5a3a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.369121 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e60ff-3905-45b9-9e21-00ccac5a3a40 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.369776 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e60ff-3905-45b9-9e21-00ccac5a3a40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:58.371413 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e60ff-3905-45b9-9e21-00ccac5a3a40 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:58.382144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1368/2769] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:58.386541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:58.396570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7827b3-9f65-422c-b3c8-14315d77cfde admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:58.401692 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:58.402424 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.402705 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.403013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] PATH_INFO: `/v3/projects/fe53521a1d5b43d4ba4c470349f7c077/users/2025fc51a99340109cbdcb58ca89556c/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.417898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe53521a1d5b43d4ba4c470349f7c077, user_id=2025fc51a99340109cbdcb58ca89556c, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:58.420564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:58.544252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1402/2770] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:58 2022] PUT /identity/v3/projects/fe53521a1d5b43d4ba4c470349f7c077/users/2025fc51a99340109cbdcb58ca89556c/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:58.555745 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e50f4-a8d1-471c-88f8-11c30c95e0a4 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.556033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e50f4-a8d1-471c-88f8-11c30c95e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.556312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e50f4-a8d1-471c-88f8-11c30c95e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.575789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:58.584609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-427e50f4-a8d1-471c-88f8-11c30c95e0a4 None None] MFA Rules not processed for user `2025fc51a99340109cbdcb58ca89556c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:58.585896 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-427e50f4-a8d1-471c-88f8-11c30c95e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:58.649376 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1369/2771] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:58.653898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:58.726449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea4b658-02f5-439f-89bf-2cfcd1c92d45 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:58.731253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:58.731871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.732157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.732440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.733070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:58.735080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:58.902542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:58.909855 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1403/2772] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:08:58 2022] POST /identity/v3/projects => generated 383 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:58.914041 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e50f4-a8d1-471c-88f8-11c30c95e0a4 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:58.924637 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e50f4-a8d1-471c-88f8-11c30c95e0a4 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:58.983371 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:58.984128 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:58.984396 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:58.984729 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:58.985414 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:58.987461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:59.097177 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1370/2773] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:08:58 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:08:59.101249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:59.115203 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df34f372-2981-4341-8b16-c74c813c28e0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:59.120105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:59.120712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:59.120991 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:59.121265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:59.121911 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:59.123569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:59.135447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1404/2774] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:59.140600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:59.150757 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3618fc4-e2e9-46c9-9026-9da0684526dc admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:59.155665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:59.156255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:59.156534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:59.156807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] PATH_INFO: `/v3/projects/5d4c0976256d4c099bdb067196a77753/users/3fd3c3b6ee1544c6aca69c210b114927/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:59.171763 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4c0976256d4c099bdb067196a77753, user_id=3fd3c3b6ee1544c6aca69c210b114927, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:59.174518 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:59.304679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1371/2775] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:59 2022] PUT /identity/v3/projects/5d4c0976256d4c099bdb067196a77753/users/3fd3c3b6ee1544c6aca69c210b114927/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:59.308874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:59.320213 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a37623-3639-4993-9b17-899e00feac7f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:59.378268 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07e24f0-0968-49c4-bb94-9b4d1f157a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:59.378908 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e24f0-0968-49c4-bb94-9b4d1f157a7d admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:59.379186 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e24f0-0968-49c4-bb94-9b4d1f157a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:59.379458 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07e24f0-0968-49c4-bb94-9b4d1f157a7d admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:59.380097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e24f0-0968-49c4-bb94-9b4d1f157a7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:59.381815 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07e24f0-0968-49c4-bb94-9b4d1f157a7d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:59.391460 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1405/2776] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:08:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:08:59.395689 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:59.406249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6fbe2f-4b57-40d1-9e39-f54c038c72c1 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:59.411160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:59.411818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:59.412199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:59.412374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] PATH_INFO: `/v3/projects/5d4c0976256d4c099bdb067196a77753/users/3fd3c3b6ee1544c6aca69c210b114927/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:59.414301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d4c0976256d4c099bdb067196a77753, user_id=3fd3c3b6ee1544c6aca69c210b114927, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:59.417149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:59.428775 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1372/2777] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:08:59 2022] PUT /identity/v3/projects/5d4c0976256d4c099bdb067196a77753/users/3fd3c3b6ee1544c6aca69c210b114927/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:08:59.440126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:59.440440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:59.440752 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:59.467829 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] MFA Rules not processed for user `3fd3c3b6ee1544c6aca69c210b114927`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:08:59.469052 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:59.537363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1406/2778] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:08:59 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:08:59.549536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:08:59.551355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:08:59.611193 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edee349b-2167-445b-a4f4-8a014da97d94 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:08:59.615209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8a62e-af55-4b0a-b609-7a0a65ebc6d5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:08:59.615814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a62e-af55-4b0a-b609-7a0a65ebc6d5 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:08:59.616099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a62e-af55-4b0a-b609-7a0a65ebc6d5 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:08:59.616374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8a62e-af55-4b0a-b609-7a0a65ebc6d5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:08:59.620502 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:08:59.673813 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8a62e-af55-4b0a-b609-7a0a65ebc6d5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:08:59.675227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8a62e-af55-4b0a-b609-7a0a65ebc6d5 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:08:59.684450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1373/2779] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:08:59 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:00.950188 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:00.952370 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:01.021372 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf8f2b-9483-43d4-9d8c-89887e6cf5a6 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:01.026314 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:01.027552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:01.027552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:01.027552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] PATH_INFO: `/v3/users/afefe153ae4f4b5b8678f636275abde0` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:01.029095 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afefe153ae4f4b5b8678f636275abde0)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:01.030817 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:01.041662 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=100 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:01.352924 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afefe153ae4f4b5b8678f636275abde0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:01.353797 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afefe153ae4f4b5b8678f636275abde0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:01.498168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afefe153ae4f4b5b8678f636275abde0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:01.506050 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afefe153ae4f4b5b8678f636275abde0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:01.519500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afefe153ae4f4b5b8678f636275abde0'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:01.525594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1407/2780] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:00 2022] DELETE /identity/v3/users/afefe153ae4f4b5b8678f636275abde0 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:01.530088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:01.530631 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:01.530801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:01.551553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:01.552818 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:01.612383 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1374/2781] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:01.622600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:01.624394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:01.688917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982a5194-61ff-4478-8979-9b4fc33aaf51 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:01.692484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:01.693108 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:01.693388 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:01.693663 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:01.705084 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:01.706523 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:01.721704 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1408/2782] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:02.220218 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:02.221794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:02.235360 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5d93e2-3806-494f-85ff-ac6dd3c38afc None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:02.241786 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:02.242539 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:02.242857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:02.243144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] PATH_INFO: `/v3/projects/460eedf2648d4ce0a5ca9aabfdb5ebec` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:02.244309 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=460eedf2648d4ce0a5ca9aabfdb5ebec)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:02.246328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:02.415510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '460eedf2648d4ce0a5ca9aabfdb5ebec', 'request_id': 'req-54378248-1633-49de-aaef-3cb3e2546fd4'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:02.422873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '460eedf2648d4ce0a5ca9aabfdb5ebec', 'request_id': 'req-54378248-1633-49de-aaef-3cb3e2546fd4'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:02.432221 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '460eedf2648d4ce0a5ca9aabfdb5ebec', 'request_id': 'req-54378248-1633-49de-aaef-3cb3e2546fd4'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:02.549497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] The token cache is being invalidate because project 460eedf2648d4ce0a5ca9aabfdb5ebec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:02.550214 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:02.550452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:02.552117 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1375/2783] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:02 2022] DELETE /identity/v3/projects/460eedf2648d4ce0a5ca9aabfdb5ebec => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:02.556557 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:02.567107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3be40-e382-4e6f-adf2-b0c6166843e5 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:02.625485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:02.626029 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:02.626316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:02.626597 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] PATH_INFO: `/v3/users/0641f507ec004bf88fe05cd3270df1c5` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:02.627793 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0641f507ec004bf88fe05cd3270df1c5)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:02.629748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:02.934397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:02.947055 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0641f507ec004bf88fe05cd3270df1c5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:02.947721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0641f507ec004bf88fe05cd3270df1c5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.064552 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0641f507ec004bf88fe05cd3270df1c5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.076275 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0641f507ec004bf88fe05cd3270df1c5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.092639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9c569a7f-770c-4e0e-9928-3545551cc373 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0641f507ec004bf88fe05cd3270df1c5'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.099819 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1409/2784] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:02 2022] DELETE /identity/v3/users/0641f507ec004bf88fe05cd3270df1c5 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:03.608574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:03.610192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:03.624850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54378248-1633-49de-aaef-3cb3e2546fd4 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:03.654754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:03.686199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:03.687437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:03.687723 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:03.688035 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] PATH_INFO: `/v3/projects/8d6ae7abb6604a7eaad5127ee4ca46ef` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:03.689323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d6ae7abb6604a7eaad5127ee4ca46ef)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:03.691298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:03.807469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d6ae7abb6604a7eaad5127ee4ca46ef', 'request_id': 'req-661a2a63-ab25-4ab4-90f7-e8c101a23abb'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.814150 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d6ae7abb6604a7eaad5127ee4ca46ef', 'request_id': 'req-661a2a63-ab25-4ab4-90f7-e8c101a23abb'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.819722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d6ae7abb6604a7eaad5127ee4ca46ef', 'request_id': 'req-661a2a63-ab25-4ab4-90f7-e8c101a23abb'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.926851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] The token cache is being invalidate because project 8d6ae7abb6604a7eaad5127ee4ca46ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:03.927162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.927876 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-661a2a63-ab25-4ab4-90f7-e8c101a23abb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:03.929469 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1376/2785] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:03 2022] DELETE /identity/v3/projects/8d6ae7abb6604a7eaad5127ee4ca46ef => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:03.936172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937eea6-db4c-40d6-942f-ea24b407d8a7 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:03.936696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937eea6-db4c-40d6-942f-ea24b407d8a7 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:03.936796 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0937eea6-db4c-40d6-942f-ea24b407d8a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:03.957594 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-0937eea6-db4c-40d6-942f-ea24b407d8a7 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:03.958845 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0937eea6-db4c-40d6-942f-ea24b407d8a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:04.020105 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1410/2786] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:04.027851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecaf26-fd15-4d6d-a423-1d463f361940 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.028146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecaf26-fd15-4d6d-a423-1d463f361940 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.028479 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ecaf26-fd15-4d6d-a423-1d463f361940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.054260 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-13ecaf26-fd15-4d6d-a423-1d463f361940 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:04.055533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-13ecaf26-fd15-4d6d-a423-1d463f361940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:04.063685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1377/2787] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:04.068149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937eea6-db4c-40d6-942f-ea24b407d8a7 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.078386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0937eea6-db4c-40d6-942f-ea24b407d8a7 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:04.083323 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:04.083948 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.084233 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.084512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.085175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:09:04.085479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:04.087157 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:04.100198 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1411/2788] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:09:04.104590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecaf26-fd15-4d6d-a423-1d463f361940 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.118844 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ecaf26-fd15-4d6d-a423-1d463f361940 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:04.123609 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:04.124300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.124803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.125261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.126239 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:04.128388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:04.249262 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1378/2789] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:09:04 2022] POST /identity/v3/projects => generated 379 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:04.253536 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.264168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd396-7c02-4477-9b13-b1c596aad294 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:04.326414 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:04.327126 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.327968 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.328433 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.329124 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:04.331593 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:04.486904 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1412/2790] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:09:04 2022] POST /identity/v3/users => generated 290 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:09:04.490973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.501739 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e64d3-df9f-4017-8fc3-2fd6d35e12d9 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:04.506292 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:04.506927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.507206 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.507496 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.508222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:04.509770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:04.520627 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1379/2791] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:04.524715 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.535840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf199b8-bf1e-4609-bcf8-ee24ddeb9041 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:04.540905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0cd0-bf88-4e07-aead-1a5d2860b5ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:04.541632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0cd0-bf88-4e07-aead-1a5d2860b5ee admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.541920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0cd0-bf88-4e07-aead-1a5d2860b5ee admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.542204 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0cd0-bf88-4e07-aead-1a5d2860b5ee admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.542906 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0cd0-bf88-4e07-aead-1a5d2860b5ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:04.544517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0cd0-bf88-4e07-aead-1a5d2860b5ee admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:04.555435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1413/2792] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:04.559548 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.569590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5856f6-407a-457b-a9a1-3b5c44017a49 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:04.574464 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:04.575164 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.575448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.575726 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] PATH_INFO: `/v3/projects/f42b8c87b82b469b878a8104ed320635/users/faf2aaab63694d929cf9b956b5af7671/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.593833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f42b8c87b82b469b878a8104ed320635, user_id=faf2aaab63694d929cf9b956b5af7671, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:04.596402 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:04.703307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1380/2793] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:04 2022] PUT /identity/v3/projects/f42b8c87b82b469b878a8104ed320635/users/faf2aaab63694d929cf9b956b5af7671/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:04.713713 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab532a06-6e21-4bb9-916d-abb0127116a4 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.714032 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab532a06-6e21-4bb9-916d-abb0127116a4 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.714311 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab532a06-6e21-4bb9-916d-abb0127116a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.742913 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ab532a06-6e21-4bb9-916d-abb0127116a4 None None] MFA Rules not processed for user `faf2aaab63694d929cf9b956b5af7671`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:04.744140 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ab532a06-6e21-4bb9-916d-abb0127116a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:04.748178 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:04.811167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1414/2794] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:04 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:04.815721 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.871961 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:04.876759 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8a3c1a-2c04-406f-9c21-e71ac1ca3a4e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:04.881511 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:04.882112 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:04.884741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:04.884741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:04.884741 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:04.885232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:04.966337 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1381/2795] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:09:04 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:04.971000 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab532a06-6e21-4bb9-916d-abb0127116a4 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:04.981928 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab532a06-6e21-4bb9-916d-abb0127116a4 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:05.038980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:05.039611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.039898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.040176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.040807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:05.042731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:05.138706 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1415/2796] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:09:04 2022] POST /identity/v3/users => generated 297 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:05.143299 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:05.154235 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e432bb72-a15d-40b5-a0b1-0f3023a7bc4a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:05.159551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:05.160149 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.160427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.160724 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.161362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:05.163049 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:05.173559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1382/2797] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:09:05.177731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:05.188590 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdc081-4274-424e-a9b7-10530213def7 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:05.193452 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:05.194111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.194394 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.194669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] PATH_INFO: `/v3/projects/2c78c99c78a844ad819dfe3920b4be84/users/6a193993370643b3bc656c939ff02f26/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.209833 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c78c99c78a844ad819dfe3920b4be84, user_id=6a193993370643b3bc656c939ff02f26, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:05.212530 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:05.291181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1416/2798] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:05 2022] PUT /identity/v3/projects/2c78c99c78a844ad819dfe3920b4be84/users/6a193993370643b3bc656c939ff02f26/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:05.300014 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:05.315258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18724184-3b5a-4045-bc36-858403d716cf admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:05.353096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:05.355007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:05.375144 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:05.375754 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.376060 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.376335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.376978 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:05.378581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:05.388590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1383/2799] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:05 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:05.392803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:05.402359 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23ca90-66fa-47fe-9dc4-39c40304f87d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:05.407657 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cd5136-5a08-41e7-b02d-e4e63703564a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:05.408301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5136-5a08-41e7-b02d-e4e63703564a admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.408587 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5136-5a08-41e7-b02d-e4e63703564a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.408866 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cd5136-5a08-41e7-b02d-e4e63703564a admin admin] PATH_INFO: `/v3/projects/2c78c99c78a844ad819dfe3920b4be84/users/6a193993370643b3bc656c939ff02f26/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.410842 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5136-5a08-41e7-b02d-e4e63703564a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c78c99c78a844ad819dfe3920b4be84, user_id=6a193993370643b3bc656c939ff02f26, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:05.413488 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cd5136-5a08-41e7-b02d-e4e63703564a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:05.415156 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e590b1a5-1037-4e92-95ab-07eefaa28ecb admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:05.418853 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:05.419459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.419741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.420015 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.422322 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:05.425170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1384/2800] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:05 2022] PUT /identity/v3/projects/2c78c99c78a844ad819dfe3920b4be84/users/6a193993370643b3bc656c939ff02f26/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:09:05.436898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf599a1-5e72-4346-b2fa-99ef7305701f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.437195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf599a1-5e72-4346-b2fa-99ef7305701f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.437482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf599a1-5e72-4346-b2fa-99ef7305701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.448357 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:05.465901 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-ebf599a1-5e72-4346-b2fa-99ef7305701f None None] MFA Rules not processed for user `6a193993370643b3bc656c939ff02f26`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:05.467338 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ebf599a1-5e72-4346-b2fa-99ef7305701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:05.487023 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:05.488468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:05.498089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1417/2801] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 24 07:09:05.537140 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1385/2802] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:05.548320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:05.549746 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:05.561551 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c285fa-c619-4e54-abe7-d10983cc1e95 service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:05.612138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bce9a1-ba07-4d17-a924-6343f4c27068 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:05.612764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce9a1-ba07-4d17-a924-6343f4c27068 service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:05.613025 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce9a1-ba07-4d17-a924-6343f4c27068 service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:05.613300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bce9a1-ba07-4d17-a924-6343f4c27068 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:05.622940 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bce9a1-ba07-4d17-a924-6343f4c27068 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:05.624468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bce9a1-ba07-4d17-a924-6343f4c27068 service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:05.634714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1418/2803] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:06.228603 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf599a1-5e72-4346-b2fa-99ef7305701f None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:06.273255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:06.294840 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf599a1-5e72-4346-b2fa-99ef7305701f None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:06.299491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:06.300132 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:06.300497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:06.300698 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] PATH_INFO: `/v3/users/faf2aaab63694d929cf9b956b5af7671` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:06.301825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=faf2aaab63694d929cf9b956b5af7671)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:06.303783 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:06.659833 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf2aaab63694d929cf9b956b5af7671'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:06.660527 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf2aaab63694d929cf9b956b5af7671'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:06.744011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf2aaab63694d929cf9b956b5af7671'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:06.757662 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf2aaab63694d929cf9b956b5af7671'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:06.765166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf2aaab63694d929cf9b956b5af7671'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:06.771365 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1386/2804] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:06 2022] DELETE /identity/v3/users/faf2aaab63694d929cf9b956b5af7671 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:06.778748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:06.778748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:06.778748 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:06.797628 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:06.798888 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:06.863932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1419/2805] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:06.874873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:06.876399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:06.934871 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9a1526-529e-4fe5-bfa6-d8440e3c15cd admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:06.938462 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:06.943098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:06.943098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:06.943098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:06.949568 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:06.951037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:06.960823 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1387/2806] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:07.517548 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:07.521522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:07.532253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f06846-ab89-4114-a47c-dbdf5887e15f None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:07.537698 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:07.538409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:07.538619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:07.538930 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] PATH_INFO: `/v3/projects/f42b8c87b82b469b878a8104ed320635` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:07.540078 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f42b8c87b82b469b878a8104ed320635)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:07.542077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:07.700808 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f42b8c87b82b469b878a8104ed320635', 'request_id': 'req-42507b1b-7cff-42b4-bd84-53a0b42b42fc'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:07.706754 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f42b8c87b82b469b878a8104ed320635', 'request_id': 'req-42507b1b-7cff-42b4-bd84-53a0b42b42fc'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:07.708515 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:07.839472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f42b8c87b82b469b878a8104ed320635', 'request_id': 'req-42507b1b-7cff-42b4-bd84-53a0b42b42fc'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:07.851649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] The token cache is being invalidate because project f42b8c87b82b469b878a8104ed320635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:07.851961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:07.852607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:07.854089 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1420/2807] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:07 2022] DELETE /identity/v3/projects/f42b8c87b82b469b878a8104ed320635 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:07.858037 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:07.868290 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f6472-96e7-463e-80b9-09d7cdcf34b1 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:07.926720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:07.926720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:07.927002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:07.927209 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] PATH_INFO: `/v3/users/6a193993370643b3bc656c939ff02f26` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:07.928809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a193993370643b3bc656c939ff02f26)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:07.930301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:07.931990 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:08.152425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a193993370643b3bc656c939ff02f26'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:08.153176 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a193993370643b3bc656c939ff02f26'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:08.378175 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a193993370643b3bc656c939ff02f26'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:08.392226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a193993370643b3bc656c939ff02f26'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:08.399770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1000841f-f6ea-4061-89fc-53c089d85ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a193993370643b3bc656c939ff02f26'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:08.405831 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1388/2808] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:07 2022] DELETE /identity/v3/users/6a193993370643b3bc656c939ff02f26 => generated 0 bytes in 548 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:08.842634 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:08.844276 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:08.858061 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42507b1b-7cff-42b4-bd84-53a0b42b42fc admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:08.921992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:08.921992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:08.921992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:08.921992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] PATH_INFO: `/v3/projects/2c78c99c78a844ad819dfe3920b4be84` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:08.922554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c78c99c78a844ad819dfe3920b4be84)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:08.922554 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:09.047375 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c78c99c78a844ad819dfe3920b4be84', 'request_id': 'req-ba7c98d2-7d26-443e-a31c-cdd0962cf038'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:09.053113 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c78c99c78a844ad819dfe3920b4be84', 'request_id': 'req-ba7c98d2-7d26-443e-a31c-cdd0962cf038'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:09.160883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c78c99c78a844ad819dfe3920b4be84', 'request_id': 'req-ba7c98d2-7d26-443e-a31c-cdd0962cf038'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:09.173664 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] The token cache is being invalidate because project 2c78c99c78a844ad819dfe3920b4be84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:09.173894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:09.174717 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-ba7c98d2-7d26-443e-a31c-cdd0962cf038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:09.176315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1421/2809] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:08 2022] DELETE /identity/v3/projects/2c78c99c78a844ad819dfe3920b4be84 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:09.181346 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a41b7-59be-47ca-9736-168d0597f195 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.181824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a41b7-59be-47ca-9736-168d0597f195 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.181940 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a41b7-59be-47ca-9736-168d0597f195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.203303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-0a5a41b7-59be-47ca-9736-168d0597f195 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:09.204551 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-0a5a41b7-59be-47ca-9736-168d0597f195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:09.263320 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1389/2810] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:09.271710 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b313da-4fa4-4a1f-97b2-687589c7a543 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.272175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b313da-4fa4-4a1f-97b2-687589c7a543 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.272655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b313da-4fa4-4a1f-97b2-687589c7a543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.294111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f1b313da-4fa4-4a1f-97b2-687589c7a543 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:09.295401 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f1b313da-4fa4-4a1f-97b2-687589c7a543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:09.306167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1422/2811] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:09.310521 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a41b7-59be-47ca-9736-168d0597f195 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:09.321104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a41b7-59be-47ca-9736-168d0597f195 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:09.329362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:09.330119 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.330449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.330735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.331971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:09:09.331971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:09.333411 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:09.354458 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1390/2812] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:09:09.356184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b313da-4fa4-4a1f-97b2-687589c7a543 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:09.366700 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b313da-4fa4-4a1f-97b2-687589c7a543 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:09.371368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:09.371967 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.372244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.372512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.373138 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:09.375235 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:09.556989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1423/2813] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:09:09 2022] POST /identity/v3/projects => generated 383 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:09.561323 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:09.572438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203232f4-fcaf-4147-a04f-e20c09ddabc4 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:09.629665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:09.630282 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.633388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.633388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.633388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:09.633388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:09.645635 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:09.790284 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1391/2814] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:09:09 2022] POST /identity/v3/users => generated 292 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:09.794610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:09.805079 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac89c3-1f45-49c5-88ab-5cfff45098d3 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:09.815569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:09.815569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.815569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.815569 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.816030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:09.816030 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:09.823461 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1424/2815] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:09.827963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:09.838009 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97284be9-45bb-41bd-a025-13e6378a2360 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:09.842664 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b73ce03-5967-4763-933a-024587c893dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:09.843927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ce03-5967-4763-933a-024587c893dc admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.844208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ce03-5967-4763-933a-024587c893dc admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.844486 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b73ce03-5967-4763-933a-024587c893dc admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.845195 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ce03-5967-4763-933a-024587c893dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:09.846963 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b73ce03-5967-4763-933a-024587c893dc admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:09.857437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1392/2816] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:09.864205 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:09.874840 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18e7bb6-6357-40e1-8361-42464d69eb96 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:09.879435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:09.882961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:09.882961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:09.882961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] PATH_INFO: `/v3/projects/8ee630ff1cd4456689e4aa86816e8478/users/e6beb993d9154a4b8aeb121164f3b9ef/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:09.896067 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ee630ff1cd4456689e4aa86816e8478, user_id=e6beb993d9154a4b8aeb121164f3b9ef, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:09.898782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:10.001620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1425/2817] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:09 2022] PUT /identity/v3/projects/8ee630ff1cd4456689e4aa86816e8478/users/e6beb993d9154a4b8aeb121164f3b9ef/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:10.012146 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a66df9-28dd-4fb8-9c01-d6e2b618263b None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.012460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a66df9-28dd-4fb8-9c01-d6e2b618263b None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.012740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a66df9-28dd-4fb8-9c01-d6e2b618263b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.041439 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-75a66df9-28dd-4fb8-9c01-d6e2b618263b None None] MFA Rules not processed for user `e6beb993d9154a4b8aeb121164f3b9ef`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:10.042649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-75a66df9-28dd-4fb8-9c01-d6e2b618263b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:10.110227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1393/2818] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:10.114835 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:10.128027 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:10.177293 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15c511-eced-43e8-87ce-23f56af4dead admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:10.182045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:10.182652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.182971 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.183250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.183878 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:10.185777 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:10.319751 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1426/2819] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:09:10 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:10.321735 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a66df9-28dd-4fb8-9c01-d6e2b618263b None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:10.333418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a66df9-28dd-4fb8-9c01-d6e2b618263b None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:10.395367 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:10.395994 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.396279 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.396559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.397203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:10.399194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:10.538956 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1394/2820] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:09:10 2022] POST /identity/v3/users => generated 297 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:10.543232 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:10.554350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc98e51-44fa-4398-9dd1-323e001724de admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:10.559049 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:10.559693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.559976 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.560250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.560894 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:10.563258 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:10.578270 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1427/2821] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:10.586685 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:10.596725 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4d610-2d57-4900-8410-d812a7be19a5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:10.601304 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:10.601951 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.602234 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.602510 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] PATH_INFO: `/v3/projects/9f34c607fe864b20833483508ce8f471/users/188329358509467897839f6ba8756f51/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.618151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f34c607fe864b20833483508ce8f471, user_id=188329358509467897839f6ba8756f51, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:10.620812 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:10.750700 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1395/2822] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:10 2022] PUT /identity/v3/projects/9f34c607fe864b20833483508ce8f471/users/188329358509467897839f6ba8756f51/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:10.754879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:10.766136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e3a4-91a7-49a6-a4ef-6709c8bf3b34 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:10.823291 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2fbb5-7fc6-48aa-9bd0-4ce1ce386a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:10.823929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2fbb5-7fc6-48aa-9bd0-4ce1ce386a2e admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.824223 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2fbb5-7fc6-48aa-9bd0-4ce1ce386a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.824495 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2fbb5-7fc6-48aa-9bd0-4ce1ce386a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.825175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2fbb5-7fc6-48aa-9bd0-4ce1ce386a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:10.826838 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2fbb5-7fc6-48aa-9bd0-4ce1ce386a2e admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:10.838107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1428/2823] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 24 07:09:10.842529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:10.853731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3734d1-369a-4cc8-8276-0af4937d7b6c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:10.858504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:10.859203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.859495 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.859777 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] PATH_INFO: `/v3/projects/9f34c607fe864b20833483508ce8f471/users/188329358509467897839f6ba8756f51/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.861686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f34c607fe864b20833483508ce8f471, user_id=188329358509467897839f6ba8756f51, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:10.864433 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:10.875909 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1396/2824] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:10 2022] PUT /identity/v3/projects/9f34c607fe864b20833483508ce8f471/users/188329358509467897839f6ba8756f51/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:10.887318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1130-da77-4289-aee8-cbb74cfc6448 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:10.887834 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1130-da77-4289-aee8-cbb74cfc6448 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:10.887944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde1130-da77-4289-aee8-cbb74cfc6448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:10.920821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-5fde1130-da77-4289-aee8-cbb74cfc6448 None None] MFA Rules not processed for user `188329358509467897839f6ba8756f51`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:10.922308 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-5fde1130-da77-4289-aee8-cbb74cfc6448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:10.995364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1429/2825] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:10 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:11.006965 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:11.009109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:11.041680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:11.070500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a97fc-d14f-46ab-bc35-bc94f59e203f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:11.074794 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:11.075397 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:11.075674 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:11.075945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:11.086691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:11.090606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:11.098350 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1397/2826] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:11.272646 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1130-da77-4289-aee8-cbb74cfc6448 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:11.282702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde1130-da77-4289-aee8-cbb74cfc6448 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:11.286651 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:11.287296 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:11.287579 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:11.287854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:11.293149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:11.346983 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:11.348449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:11.357412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1430/2827] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:11 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:11.785287 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:11.786781 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:11.857793 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a15b7b-9a6c-45cc-bc3e-3fbc0334cd09 service cinder] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:11.863328 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:11.863969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:11.864255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:11.864533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] PATH_INFO: `/v3/users/2025fc51a99340109cbdcb58ca89556c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:11.865709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2025fc51a99340109cbdcb58ca89556c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:11.867712 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:11.899172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:11.910655 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806f96-f8a7-4944-8a8f-42e584a51fda service cinder] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:11.915795 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:11.916425 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:11.916709 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:11.916989 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] PATH_INFO: `/v3/users/e6beb993d9154a4b8aeb121164f3b9ef` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:11.918139 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6beb993d9154a4b8aeb121164f3b9ef)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:11.920151 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:12.064331 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2025fc51a99340109cbdcb58ca89556c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.068482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2025fc51a99340109cbdcb58ca89556c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.173947 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6beb993d9154a4b8aeb121164f3b9ef'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.174622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6beb993d9154a4b8aeb121164f3b9ef'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.216238 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2025fc51a99340109cbdcb58ca89556c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.231285 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2025fc51a99340109cbdcb58ca89556c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.245932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-7814ab30-f43b-43e3-8ddc-5e298dcb9e5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2025fc51a99340109cbdcb58ca89556c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.245932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1398/2828] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:11 2022] DELETE /identity/v3/users/2025fc51a99340109cbdcb58ca89556c => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:12.248826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:12.249319 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:12.249826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:12.270618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:12.271854 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:12.316740 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:12.332715 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1399/2829] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:09:12.343883 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:12.345335 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:12.400679 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d73142-4c0d-426f-aebb-3979243a9a95 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:12.402483 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6beb993d9154a4b8aeb121164f3b9ef'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.404873 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26487058-af8a-428b-8986-4fadbe55cb46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:12.406052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487058-af8a-428b-8986-4fadbe55cb46 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:12.406333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487058-af8a-428b-8986-4fadbe55cb46 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:12.406607 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26487058-af8a-428b-8986-4fadbe55cb46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:12.411119 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6beb993d9154a4b8aeb121164f3b9ef'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.416104 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26487058-af8a-428b-8986-4fadbe55cb46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:12.417536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26487058-af8a-428b-8986-4fadbe55cb46 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:12.425764 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6beb993d9154a4b8aeb121164f3b9ef'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:12.427536 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1400/2830] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:12.432485 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1431/2831] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:11 2022] DELETE /identity/v3/users/e6beb993d9154a4b8aeb121164f3b9ef => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:09:12.437083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:12.437419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:12.437692 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:12.459090 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:12.460345 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:12.522569 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1401/2832] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:12.532649 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:12.534168 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:12.593107 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bdaf1-da6d-4455-8bad-a1259c7441ab admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:12.596916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:12.599826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:12.599826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:12.599826 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:12.607635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:12.609219 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:12.619014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1432/2833] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:12.916265 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:12.917881 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:12.931301 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cec74f-9ab9-4e22-8994-49f92052b3ca None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:12.937461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:12.937461 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:12.938606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:12.939025 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] PATH_INFO: `/v3/projects/fe53521a1d5b43d4ba4c470349f7c077` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:12.940380 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe53521a1d5b43d4ba4c470349f7c077)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:12.942845 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:13.102620 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:13.104361 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:13.118927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254332a4-7dd7-4ab8-9200-9ed2267e73d5 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:13.124004 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe53521a1d5b43d4ba4c470349f7c077', 'request_id': 'req-1ca7b357-64cf-4503-ae0a-afa1a128b556'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.131012 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe53521a1d5b43d4ba4c470349f7c077', 'request_id': 'req-1ca7b357-64cf-4503-ae0a-afa1a128b556'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.143770 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:13.144969 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe53521a1d5b43d4ba4c470349f7c077', 'request_id': 'req-1ca7b357-64cf-4503-ae0a-afa1a128b556'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.185721 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:13.186409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:13.187248 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:13.187529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] PATH_INFO: `/v3/projects/8ee630ff1cd4456689e4aa86816e8478` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:13.188740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ee630ff1cd4456689e4aa86816e8478)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:13.190661 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:13.246427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] The token cache is being invalidate because project fe53521a1d5b43d4ba4c470349f7c077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:13.246722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.247426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.249543 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1402/2834] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:12 2022] DELETE /identity/v3/projects/fe53521a1d5b43d4ba4c470349f7c077 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:13.253393 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:13.254736 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:13.267485 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b357-64cf-4503-ae0a-afa1a128b556 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:13.276086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:13.276086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:13.276086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:13.276086 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] PATH_INFO: `/v3/users/3fd3c3b6ee1544c6aca69c210b114927` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:13.276467 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fd3c3b6ee1544c6aca69c210b114927)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:13.276644 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:13.288849 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:13.321724 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ee630ff1cd4456689e4aa86816e8478', 'request_id': 'req-df29bc01-215a-4787-bcc7-546caa1cdc04'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.327109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ee630ff1cd4456689e4aa86816e8478', 'request_id': 'req-df29bc01-215a-4787-bcc7-546caa1cdc04'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.435920 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ee630ff1cd4456689e4aa86816e8478', 'request_id': 'req-df29bc01-215a-4787-bcc7-546caa1cdc04'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.449214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] The token cache is being invalidate because project 8ee630ff1cd4456689e4aa86816e8478 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:13.449510 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.450319 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.451915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1433/2835] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:13 2022] DELETE /identity/v3/projects/8ee630ff1cd4456689e4aa86816e8478 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:13.455965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:13.457390 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:13.495210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fd3c3b6ee1544c6aca69c210b114927'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.496215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fd3c3b6ee1544c6aca69c210b114927'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.521517 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df29bc01-215a-4787-bcc7-546caa1cdc04 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:13.526252 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:13.526922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:13.527207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:13.527484 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] PATH_INFO: `/v3/users/188329358509467897839f6ba8756f51` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:13.528635 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=188329358509467897839f6ba8756f51)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:13.531077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:13.606374 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fd3c3b6ee1544c6aca69c210b114927'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.622412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fd3c3b6ee1544c6aca69c210b114927'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.629438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fd3c3b6ee1544c6aca69c210b114927'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.636109 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1403/2836] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:13 2022] DELETE /identity/v3/users/3fd3c3b6ee1544c6aca69c210b114927 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:09:13.720592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '188329358509467897839f6ba8756f51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.721301 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '188329358509467897839f6ba8756f51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.789384 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '188329358509467897839f6ba8756f51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.797103 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '188329358509467897839f6ba8756f51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.808857 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '188329358509467897839f6ba8756f51'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:13.814689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1434/2837] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:13 2022] DELETE /identity/v3/users/188329358509467897839f6ba8756f51 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:09:14.125694 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:14.127294 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:14.198429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda9f826-91dd-42dc-9acc-491a3d0922f8 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:14.247115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:14.252397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:14.254960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:14.255620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:14.256512 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:14.256864 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] PATH_INFO: `/v3/projects/5d4c0976256d4c099bdb067196a77753` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:14.258232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d4c0976256d4c099bdb067196a77753)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:14.260406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:14.264376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef97fd9-4033-4269-8a8b-ec2c88a89f4f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:14.270149 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:14.271100 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:14.271600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:14.272270 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] PATH_INFO: `/v3/projects/9f34c607fe864b20833483508ce8f471` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:14.273632 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f34c607fe864b20833483508ce8f471)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:14.276964 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:14.336169 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:14.405169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d4c0976256d4c099bdb067196a77753', 'request_id': 'req-5c336861-5baa-4547-bc8e-a200140557e6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.406102 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f34c607fe864b20833483508ce8f471', 'request_id': 'req-7b0c5d88-6530-4c21-8520-7951fa7c4004'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.411375 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d4c0976256d4c099bdb067196a77753', 'request_id': 'req-5c336861-5baa-4547-bc8e-a200140557e6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.414245 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f34c607fe864b20833483508ce8f471', 'request_id': 'req-7b0c5d88-6530-4c21-8520-7951fa7c4004'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.417362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d4c0976256d4c099bdb067196a77753', 'request_id': 'req-5c336861-5baa-4547-bc8e-a200140557e6'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.473314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:14.497802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f34c607fe864b20833483508ce8f471', 'request_id': 'req-7b0c5d88-6530-4c21-8520-7951fa7c4004'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.510393 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] The token cache is being invalidate because project 9f34c607fe864b20833483508ce8f471 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:14.510686 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.511376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-7b0c5d88-6530-4c21-8520-7951fa7c4004 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.512881 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1435/2838] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:14 2022] DELETE /identity/v3/projects/9f34c607fe864b20833483508ce8f471 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:14.605426 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] The token cache is being invalidate because project 5d4c0976256d4c099bdb067196a77753 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:14.605853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.606830 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-5c336861-5baa-4547-bc8e-a200140557e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:14.609484 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1404/2839] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:14 2022] DELETE /identity/v3/projects/5d4c0976256d4c099bdb067196a77753 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:14.616660 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021aad8-b289-48fb-877d-a831c972dafa None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:14.616957 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021aad8-b289-48fb-877d-a831c972dafa None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:14.617269 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a021aad8-b289-48fb-877d-a831c972dafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:14.639572 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a021aad8-b289-48fb-877d-a831c972dafa None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:14.640831 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a021aad8-b289-48fb-877d-a831c972dafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:14.708130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1436/2840] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:14.717013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd079f7c-9cd4-44d2-b6ea-255c35309914 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:14.717326 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd079f7c-9cd4-44d2-b6ea-255c35309914 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:14.718192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd079f7c-9cd4-44d2-b6ea-255c35309914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:14.739491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-bd079f7c-9cd4-44d2-b6ea-255c35309914 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:14.740787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-bd079f7c-9cd4-44d2-b6ea-255c35309914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:14.750340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1405/2841] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:14.754814 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021aad8-b289-48fb-877d-a831c972dafa None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:14.765500 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a021aad8-b289-48fb-877d-a831c972dafa None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:14.770645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:14.771318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:14.771599 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:14.771876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:14.772543 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:09:14.772848 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:14.774498 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:14.787221 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1437/2842] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:09:14.799179 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd079f7c-9cd4-44d2-b6ea-255c35309914 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:14.808599 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd079f7c-9cd4-44d2-b6ea-255c35309914 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:14.814154 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:14.814867 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:14.815155 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:14.815437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:14.816077 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:14.817984 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:14.939829 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1406/2843] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:09:14 2022] POST /identity/v3/projects => generated 377 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:14.945508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:14.958570 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3292b-3de0-4c5e-939b-a223e7e7709c admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:15.000132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:15.016014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:15.016647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:15.016931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:15.017212 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:15.017859 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:15.019820 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:15.201789 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1438/2844] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:09:14 2022] POST /identity/v3/users => generated 289 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:15.206384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:15.217120 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75272b3-1eab-4512-9d1f-ebb77812b97d admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:15.222528 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:15.223170 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:15.223453 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:15.223731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:15.224384 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:15.225985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:15.236385 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1407/2845] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:15.240627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:15.250574 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0a1856-e796-4846-94e1-4f130abe482f admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:15.255905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ce3463-6fe3-41e0-9e3c-05ce97c0dd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:15.256512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce3463-6fe3-41e0-9e3c-05ce97c0dd9f admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:15.256821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce3463-6fe3-41e0-9e3c-05ce97c0dd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:15.257101 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ce3463-6fe3-41e0-9e3c-05ce97c0dd9f admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:15.257740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce3463-6fe3-41e0-9e3c-05ce97c0dd9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:15.259379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ce3463-6fe3-41e0-9e3c-05ce97c0dd9f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:15.272069 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1439/2846] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:15.276047 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:15.286928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d8ed7e-8fb5-4563-a1d0-eb6e2ac82d38 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:15.291618 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:15.292281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:15.292572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:15.292855 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] PATH_INFO: `/v3/projects/d251a728a1c747bb963bc0712f377bc4/users/5ee2cd89e9684d2cb04d9bca0a1365bd/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:15.311192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d251a728a1c747bb963bc0712f377bc4, user_id=5ee2cd89e9684d2cb04d9bca0a1365bd, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:15.313898 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:15.470744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1408/2847] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:15 2022] PUT /identity/v3/projects/d251a728a1c747bb963bc0712f377bc4/users/5ee2cd89e9684d2cb04d9bca0a1365bd/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:15.538265 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cbc61-5361-4ca4-be17-92465a382ce2 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:15.538813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cbc61-5361-4ca4-be17-92465a382ce2 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:15.539109 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50cbc61-5361-4ca4-be17-92465a382ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:15.569938 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-d50cbc61-5361-4ca4-be17-92465a382ce2 None None] MFA Rules not processed for user `5ee2cd89e9684d2cb04d9bca0a1365bd`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:15.571563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d50cbc61-5361-4ca4-be17-92465a382ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:15.637390 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1440/2848] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:15.652339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:15.654098 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:15.712649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21281a6-fa28-455c-8b4d-38575bfdfd9c admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:15.716732 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1ae9ef-e756-4301-b3cf-5afbab317d5a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cc7c77697ae44017bfb40f9c77ffea1c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:15.717425 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ae9ef-e756-4301-b3cf-5afbab317d5a service cinder] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:15.717654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ae9ef-e756-4301-b3cf-5afbab317d5a service cinder] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:15.717935 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1ae9ef-e756-4301-b3cf-5afbab317d5a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:15.726853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ae9ef-e756-4301-b3cf-5afbab317d5a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:15.728220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1ae9ef-e756-4301-b3cf-5afbab317d5a service cinder] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:15.737013 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1409/2849] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:15 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:25.634541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:25.733460 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=64,keystone:DELETE=4,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:31.596547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cbc61-5361-4ca4-be17-92465a382ce2 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:31.658730 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50cbc61-5361-4ca4-be17-92465a382ce2 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:31.663313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:31.663944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:31.664249 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:31.664522 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] PATH_INFO: `/v3/users/5ee2cd89e9684d2cb04d9bca0a1365bd` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:31.665720 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ee2cd89e9684d2cb04d9bca0a1365bd)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:31.667716 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:31.900893 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ee2cd89e9684d2cb04d9bca0a1365bd'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:31.901537 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ee2cd89e9684d2cb04d9bca0a1365bd'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:31.969990 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ee2cd89e9684d2cb04d9bca0a1365bd'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:31.977347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ee2cd89e9684d2cb04d9bca0a1365bd'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:31.989363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ee2cd89e9684d2cb04d9bca0a1365bd'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:31.995362 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1441/2850] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:09:31 2022] DELETE /identity/v3/users/5ee2cd89e9684d2cb04d9bca0a1365bd => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:31.999962 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:32.000470 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:32.000579 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:32.020810 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:32.022071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:32.081734 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1410/2851] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:32.091459 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:32.092918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:32.151324 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9225b3c9-18da-43c9-b149-6d4dabde4587 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:32.155039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6a01c-f113-4036-8d2a-59880d67ac12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:32.155648 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6a01c-f113-4036-8d2a-59880d67ac12 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:32.155932 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6a01c-f113-4036-8d2a-59880d67ac12 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:32.156209 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6a01c-f113-4036-8d2a-59880d67ac12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:32.165456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6a01c-f113-4036-8d2a-59880d67ac12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:32.166916 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c6a01c-f113-4036-8d2a-59880d67ac12 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:32.176525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1442/2852] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:32.665357 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:32.666850 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:32.682678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523affd-b55f-4bf8-9cc9-94af70b09353 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:32.688523 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:32.689976 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:32.690271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:32.690722 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] PATH_INFO: `/v3/projects/d251a728a1c747bb963bc0712f377bc4` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:32.691930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d251a728a1c747bb963bc0712f377bc4)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:32.694192 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:32.845547 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd251a728a1c747bb963bc0712f377bc4', 'request_id': 'req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:32.852261 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd251a728a1c747bb963bc0712f377bc4', 'request_id': 'req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:32.858639 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd251a728a1c747bb963bc0712f377bc4', 'request_id': 'req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:32.941092 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] The token cache is being invalidate because project d251a728a1c747bb963bc0712f377bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:09:32.941308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:32.941924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-c2f3ab27-636e-4bcb-956f-c0d9039c0e32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:09:32.943452 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1411/2853] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:09:32 2022] DELETE /identity/v3/projects/d251a728a1c747bb963bc0712f377bc4 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:32.949417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317c9c-1853-43d6-ae90-282984145934 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:32.949944 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317c9c-1853-43d6-ae90-282984145934 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:32.950057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317c9c-1853-43d6-ae90-282984145934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:32.970115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-f5317c9c-1853-43d6-ae90-282984145934 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:32.971497 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-f5317c9c-1853-43d6-ae90-282984145934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:32.989285 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:33.032086 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1443/2854] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:33.039933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca50e6-2adc-430d-809f-4f405aec4161 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.040421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca50e6-2adc-430d-809f-4f405aec4161 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.040544 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ca50e6-2adc-430d-809f-4f405aec4161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.060932 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b0ca50e6-2adc-430d-809f-4f405aec4161 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:33.062158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b0ca50e6-2adc-430d-809f-4f405aec4161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:33.070159 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1412/2855] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 24 07:09:33.074800 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317c9c-1853-43d6-ae90-282984145934 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:33.085261 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317c9c-1853-43d6-ae90-282984145934 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:33.090607 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:33.091256 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.091540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.092350 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] PATH_INFO: `/v3/domains` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.093039 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93390) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:09:33.093347 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:33.095014 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:33.106956 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1444/2856] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 24 07:09:33.111960 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca50e6-2adc-430d-809f-4f405aec4161 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:33.122412 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ca50e6-2adc-430d-809f-4f405aec4161 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:33.126688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:33.130621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.130621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.130621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.130621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:33.130621 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:33.265605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1413/2857] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:09:33 2022] POST /identity/v3/projects => generated 385 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:09:33.269874 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:33.280939 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb872e-176c-41dc-8322-3aefc058c05b admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:33.337847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:33.338556 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.338948 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.339294 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.339974 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:33.342610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:33.464312 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1445/2858] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:09:33 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:33.468897 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:33.479203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef457c8d-b7d8-4152-b57b-c04898333eba admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:33.483845 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:33.484572 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.484924 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.485143 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.485791 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:33.487432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:33.497619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1414/2859] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:33.501564 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:33.511693 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aa82d5-ee6a-4f41-bd07-e571390bf0fa admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:33.517081 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2afd62c-28d3-4410-becd-05d0e2e8e66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:33.517684 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd62c-28d3-4410-becd-05d0e2e8e66f admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.517969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd62c-28d3-4410-becd-05d0e2e8e66f admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.518250 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2afd62c-28d3-4410-becd-05d0e2e8e66f admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.518973 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afd62c-28d3-4410-becd-05d0e2e8e66f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:33.520622 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2afd62c-28d3-4410-becd-05d0e2e8e66f admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:33.532009 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1446/2860] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:33.536307 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:33.546312 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d03cfca-44b7-4666-9aa4-9cce4420df1e admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:33.550939 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:33.551590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.551875 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.552162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] PATH_INFO: `/v3/projects/77d07f47432e40b1a5ee5c828a1ec9a8/users/ba037d4669224543862f8594324b70f3/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.567226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] RBAC: Authorizing `identity:create_grant(project_id=77d07f47432e40b1a5ee5c828a1ec9a8, user_id=ba037d4669224543862f8594324b70f3, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:33.569911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:33.686438 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1415/2861] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:33 2022] PUT /identity/v3/projects/77d07f47432e40b1a5ee5c828a1ec9a8/users/ba037d4669224543862f8594324b70f3/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:09:33.691782 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcd5e-8c67-4139-9015-9e22b74a428c None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.692074 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcd5e-8c67-4139-9015-9e22b74a428c None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.692354 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9dcd5e-8c67-4139-9015-9e22b74a428c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.712115 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-3c9dcd5e-8c67-4139-9015-9e22b74a428c None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:33.713346 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-3c9dcd5e-8c67-4139-9015-9e22b74a428c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:33.775980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1447/2862] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:33.786186 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:33.787927 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:33.810826 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:33.846302 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63fca42-0a0f-4798-9517-9f55373e0310 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:33.850535 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:33.851172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:33.851459 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:33.851816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:33.861160 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:33.862590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:33.871884 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1416/2863] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:39.679931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fc74-c7ee-441a-841f-27736a2cc463 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:39.680547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fc74-c7ee-441a-841f-27736a2cc463 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:39.680547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf4fc74-c7ee-441a-841f-27736a2cc463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:39.711667 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-ebf4fc74-c7ee-441a-841f-27736a2cc463 None None] MFA Rules not processed for user `ba037d4669224543862f8594324b70f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:39.712918 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-ebf4fc74-c7ee-441a-841f-27736a2cc463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:39.733090 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:39.780921 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1448/2864] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:39 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:39.785002 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:39.795293 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4307ef35-c8cd-4b36-93c6-6722dde46e87 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:39.802824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:39.802824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:39.802824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:39.802824 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] PATH_INFO: `/v3/projects` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:39.803381 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:39.804705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:39.900172 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1417/2865] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:09:39 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:39.904338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4fc74-c7ee-441a-841f-27736a2cc463 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:39.916613 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf4fc74-c7ee-441a-841f-27736a2cc463 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:39.977494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:39.978163 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:39.978447 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:39.978735 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] PATH_INFO: `/v3/users` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:39.979420 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:39.981410 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:40.097945 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1449/2866] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:09:39 2022] POST /identity/v3/users => generated 298 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:09:40.101945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:40.113340 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aac3c5-da26-4c57-85c7-1218c8c97e62 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:40.123059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:40.123059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:40.123059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:40.123059 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:40.123533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:40.123533 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:40.134447 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1418/2867] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:40.138821 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:40.149508 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5086c724-1dc3-4603-98a8-915a636433a0 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:40.154529 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:40.157376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:40.157376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:40.157376 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] PATH_INFO: `/v3/projects/d752f25b4c4e40039d0d18dfa97e183d/users/55fbbd0c3dd849a19988e699584cef5c/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:40.172600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d752f25b4c4e40039d0d18dfa97e183d, user_id=55fbbd0c3dd849a19988e699584cef5c, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:40.175592 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:40.298520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1450/2868] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:40 2022] PUT /identity/v3/projects/d752f25b4c4e40039d0d18dfa97e183d/users/55fbbd0c3dd849a19988e699584cef5c/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:09:40.302684 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:40.315404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe583595-9889-49f3-935a-6fe7751c44b2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:40.371605 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0355816-21d3-46ef-941d-a1ac8b02b8ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:40.372220 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0355816-21d3-46ef-941d-a1ac8b02b8ae admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:40.372507 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0355816-21d3-46ef-941d-a1ac8b02b8ae admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:40.372789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0355816-21d3-46ef-941d-a1ac8b02b8ae admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:40.373437 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0355816-21d3-46ef-941d-a1ac8b02b8ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:40.375630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0355816-21d3-46ef-941d-a1ac8b02b8ae admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:40.385594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1419/2869] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:09:40.390435 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:40.401879 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1ddab-8eae-4ecb-93ee-4f07cfea92a7 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:40.406839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:40.407504 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:40.407786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:40.408062 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] PATH_INFO: `/v3/projects/d752f25b4c4e40039d0d18dfa97e183d/users/55fbbd0c3dd849a19988e699584cef5c/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:40.410045 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d752f25b4c4e40039d0d18dfa97e183d, user_id=55fbbd0c3dd849a19988e699584cef5c, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:40.412769 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:40.423316 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1451/2870] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:09:40 2022] PUT /identity/v3/projects/d752f25b4c4e40039d0d18dfa97e183d/users/55fbbd0c3dd849a19988e699584cef5c/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 24 07:09:46.147693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3a12-896a-4711-a9e0-bb7d4983629f None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:46.148232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3a12-896a-4711-a9e0-bb7d4983629f None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:46.148232 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3a12-896a-4711-a9e0-bb7d4983629f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:46.177310 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-41dd3a12-896a-4711-a9e0-bb7d4983629f None None] MFA Rules not processed for user `55fbbd0c3dd849a19988e699584cef5c`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:46.184688 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-41dd3a12-896a-4711-a9e0-bb7d4983629f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:46.256122 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1420/2871] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:46.269525 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:46.271379 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:46.351386 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f5d26-549d-4f34-ae53-47891485c74d admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:46.354910 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4aaee9d82b74c45a3a7352595614850', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:46.355514 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:46.355812 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:46.356080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:46.360408 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:46.413264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:46.414696 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:46.423540 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1452/2872] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:46.869966 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db3b3-84f2-4190-b1ee-0f2d5d1411bf None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:46.870258 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db3b3-84f2-4190-b1ee-0f2d5d1411bf None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:46.870553 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92db3b3-84f2-4190-b1ee-0f2d5d1411bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:46.890063 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:46.933281 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-a92db3b3-84f2-4190-b1ee-0f2d5d1411bf None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:46.934524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a92db3b3-84f2-4190-b1ee-0f2d5d1411bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:47.007590 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1421/2873] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 07:09:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:47.165253 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:47.169856 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:47.258694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a27732e-4d9d-44f7-86e8-12d153fc6b6e service glance] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:47.263847 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:47.264456 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:47.264738 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:47.265016 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:47.273876 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:47.275695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:47.284468 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1453/2874] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:09:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:09:57.004652 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=39 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:57.281132 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=66 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:09:57.757210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:57.757500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:57.757780 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:57.776600 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] MFA Rules not processed for user `ba037d4669224543862f8594324b70f3`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:09:57.777809 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:57.785308 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1422/2875] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:09:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:09:58.046873 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:58.101865 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45924cf7-6d07-4d43-8344-fded9afe5b4f service swift] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:58.105512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e2dd4-c349-4e02-809d-c680106e2df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:58.106121 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2dd4-c349-4e02-809d-c680106e2df4 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:58.106426 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2dd4-c349-4e02-809d-c680106e2df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:58.106712 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e2dd4-c349-4e02-809d-c680106e2df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:58.108654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-dd7e2dd4-c349-4e02-809d-c680106e2df4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:58.118617 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2dd4-c349-4e02-809d-c680106e2df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:58.120097 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e2dd4-c349-4e02-809d-c680106e2df4 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:58.128348 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1454/2876] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:09:58.588207 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:09:58.589634 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:58.662151 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d796b03-e23e-4793-b3e6-18ff7bcef508 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:09:58.667096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:09:58.667706 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:09:58.668001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:09:58.668280 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:09:58.669999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:09:58.682874 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:09:58.684649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:09:58.695619 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1423/2877] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:09:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:10:02.271668 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93f5e-9005-4f45-9ad2-33dc2dfee24b None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:10:02.272125 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93f5e-9005-4f45-9ad2-33dc2dfee24b None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:10:02.272222 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b93f5e-9005-4f45-9ad2-33dc2dfee24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:10:02.291214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a8b93f5e-9005-4f45-9ad2-33dc2dfee24b None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:10:02.292449 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a8b93f5e-9005-4f45-9ad2-33dc2dfee24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:10:02.299602 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1455/2878] 10.222.0.59 () {58 vars in 1009 bytes} [Wed Aug 24 07:10:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:10:02.311878 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:10:02.324166 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7db58b-55f6-40ae-a0c8-b5bc4d1ea561 service placement] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:10:02.329887 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:10:02.330493 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:10:02.330801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:10:02.331083 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:10:02.339163 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:10:02.340744 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:10:02.348919 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1424/2879] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:10:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:10:09.867184 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93f5e-9005-4f45-9ad2-33dc2dfee24b None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:10:09.878320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b93f5e-9005-4f45-9ad2-33dc2dfee24b None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:10:09.882961 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:10:09.883576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:10:09.883862 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:10:09.884181 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:10:09.886852 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:10:09.899896 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:10:09.901351 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:10:09.911292 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1456/2880] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:10:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:10:10.708314 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:10:10.709879 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:10:10.784760 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5a17b4-618a-40f3-91c1-2b0e20f994f8 service swift] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:10:10.790680 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:10:10.791362 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:10:10.791650 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:10:10.791928 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:10:10.793751 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:10:10.806693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:10:10.808434 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:10:10.819753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1425/2881] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:10:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:10:16.562491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:10:16.576487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a749ecc-0574-4d8c-a5a8-e580381d21a3 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:10:16.582647 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:10:16.583279 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:10:16.583561 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:10:16.583839 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:10:16.585608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:10:16.598003 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:10:16.599606 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:10:16.610758 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1457/2882] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:10:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:10:20.815630 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=75 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:10:25.686606 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:10:25.697454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be8f4a-b4b5-44cc-8fd8-8c180909d02b service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:10:25.701379 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:10:25.701992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:10:25.702296 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:10:25.702577 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:10:25.712231 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:10:25.713655 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:10:25.723558 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1426/2883] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:10:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:10:26.605740 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=41 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:10:35.719108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=6 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:11:11.806993 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:11:11.808411 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:11:11.823215 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c147f53f-4803-4c18-bd59-7a4f1690fed3 service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:11:11.828254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd341db-d54e-4929-bda8-70a75de4bc6c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:11:11.828849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd341db-d54e-4929-bda8-70a75de4bc6c service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:11.829136 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd341db-d54e-4929-bda8-70a75de4bc6c service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:11.829417 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd341db-d54e-4929-bda8-70a75de4bc6c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:11.831130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-1cd341db-d54e-4929-bda8-70a75de4bc6c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:11:11.842283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd341db-d54e-4929-bda8-70a75de4bc6c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:11:11.843890 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd341db-d54e-4929-bda8-70a75de4bc6c service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:11:11.858230 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1458/2884] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:11:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:11:21.849576 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:11:42.122561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:11:42.137114 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcf8871-c7e1-45dc-b294-c6c1a3cde73a service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:11:42.143240 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:11:42.144765 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:42.145342 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:42.145720 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:42.149557 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:11:42.163515 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:11:42.165162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:11:42.177709 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1427/2885] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:11:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:11:50.089320 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6adaf-e5ce-456c-8b48-bc4e8ca6e811 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:50.089802 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6adaf-e5ce-456c-8b48-bc4e8ca6e811 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:50.089917 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b6adaf-e5ce-456c-8b48-bc4e8ca6e811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:50.108491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a2b6adaf-e5ce-456c-8b48-bc4e8ca6e811 None None] MFA Rules not processed for user `59375961363e484ca6607126bbf0741b`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:11:50.109707 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a2b6adaf-e5ce-456c-8b48-bc4e8ca6e811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:11:50.116697 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1459/2886] 10.222.0.59 () {58 vars in 967 bytes} [Wed Aug 24 07:11:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:11:50.156348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:11:50.167620 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d262023-b897-4bbe-bfd1-507dc6d5294b service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:11:50.172497 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1dfd6a8d9194f7a949a77207931eb15', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:11:50.173087 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:50.173372 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:50.173651 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:50.182158 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:11:50.183770 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:11:50.191691 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1428/2887] 10.222.0.59 () {60 vars in 1384 bytes} [Wed Aug 24 07:11:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 24 07:11:54.783980 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6adaf-e5ce-456c-8b48-bc4e8ca6e811 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:11:54.798421 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b6adaf-e5ce-456c-8b48-bc4e8ca6e811 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:11:54.803409 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:11:54.804013 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:54.804290 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:54.804567 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:54.807059 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:11:54.818854 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:11:54.820446 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:11:54.830741 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1460/2888] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:11:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:11:58.532578 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:11:58.595210 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aac66f9-736c-497b-b5f7-5bb7807dfb4f service swift] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:11:58.599752 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:11:58.600377 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:58.600663 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:58.600945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] PATH_INFO: `/v3/users/ba037d4669224543862f8594324b70f3` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:58.602071 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba037d4669224543862f8594324b70f3)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:11:58.604048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:11:58.753814 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba037d4669224543862f8594324b70f3'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:58.754489 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba037d4669224543862f8594324b70f3'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:58.837418 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba037d4669224543862f8594324b70f3'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:58.851731 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba037d4669224543862f8594324b70f3'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:58.856992 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba037d4669224543862f8594324b70f3'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:58.862858 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1429/2889] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:11:58 2022] DELETE /identity/v3/users/ba037d4669224543862f8594324b70f3 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:11:59.110811 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:11:59.123242 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddbca89-8b31-42e0-a0f8-111dd319c070 service placement] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:11:59.180053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:11:59.181172 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:59.181454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:59.181727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] PATH_INFO: `/v3/projects/77d07f47432e40b1a5ee5c828a1ec9a8` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:59.182883 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=77d07f47432e40b1a5ee5c828a1ec9a8)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:11:59.184784 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:11:59.282629 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77d07f47432e40b1a5ee5c828a1ec9a8', 'request_id': 'req-fb860ac1-f039-48bc-b39e-61cbc59d1b70'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.289134 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77d07f47432e40b1a5ee5c828a1ec9a8', 'request_id': 'req-fb860ac1-f039-48bc-b39e-61cbc59d1b70'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.357068 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77d07f47432e40b1a5ee5c828a1ec9a8', 'request_id': 'req-fb860ac1-f039-48bc-b39e-61cbc59d1b70'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.368487 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] The token cache is being invalidate because project 77d07f47432e40b1a5ee5c828a1ec9a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:11:59.368806 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.369440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.370931 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1461/2890] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:11:59 2022] DELETE /identity/v3/projects/77d07f47432e40b1a5ee5c828a1ec9a8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:11:59.374973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:11:59.376369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:11:59.389298 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20f3ea-007c-4433-aa31-610178cb30b5 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:11:59.435750 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:11:59.444361 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:11:59.445908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:11:59.445908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:11:59.445908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] PATH_INFO: `/v3/users/55fbbd0c3dd849a19988e699584cef5c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:11:59.447061 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55fbbd0c3dd849a19988e699584cef5c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:11:59.449020 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:11:59.685333 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55fbbd0c3dd849a19988e699584cef5c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.686001 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55fbbd0c3dd849a19988e699584cef5c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.757388 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55fbbd0c3dd849a19988e699584cef5c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.769659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55fbbd0c3dd849a19988e699584cef5c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.778665 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-8e439790-058f-4da2-8c6a-d5cc07887c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55fbbd0c3dd849a19988e699584cef5c'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:11:59.785451 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1430/2891] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:11:59 2022] DELETE /identity/v3/users/55fbbd0c3dd849a19988e699584cef5c => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:12:00.062053 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:00.063608 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:00.078315 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb860ac1-f039-48bc-b39e-61cbc59d1b70 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:00.135988 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:00.136644 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.136898 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.137180 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] PATH_INFO: `/v3/projects/d752f25b4c4e40039d0d18dfa97e183d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.138325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d752f25b4c4e40039d0d18dfa97e183d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:00.140257 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:00.152283 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:12:00.291842 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd752f25b4c4e40039d0d18dfa97e183d', 'request_id': 'req-15edf0d8-a0ed-42f2-a41f-3186c069abb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:12:00.297111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd752f25b4c4e40039d0d18dfa97e183d', 'request_id': 'req-15edf0d8-a0ed-42f2-a41f-3186c069abb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:12:00.447033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd752f25b4c4e40039d0d18dfa97e183d', 'request_id': 'req-15edf0d8-a0ed-42f2-a41f-3186c069abb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:12:00.458303 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] The token cache is being invalidate because project d752f25b4c4e40039d0d18dfa97e183d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93390) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:12:00.458596 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:12:00.459400 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-15edf0d8-a0ed-42f2-a41f-3186c069abb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:12:00.461427 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1462/2892] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:12:00 2022] DELETE /identity/v3/projects/d752f25b4c4e40039d0d18dfa97e183d => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:12:00.466566 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7c688-a273-440f-a490-4e95b1507820 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.466912 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7c688-a273-440f-a490-4e95b1507820 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.467226 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7c688-a273-440f-a490-4e95b1507820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.486574 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-b3c7c688-a273-440f-a490-4e95b1507820 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:12:00.488517 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-b3c7c688-a273-440f-a490-4e95b1507820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:00.548565 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1431/2893] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:12:00.556491 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22c50-59d2-49b8-9227-8995485ecf05 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.557341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22c50-59d2-49b8-9227-8995485ecf05 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.557600 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c22c50-59d2-49b8-9227-8995485ecf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.578598 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-34c22c50-59d2-49b8-9227-8995485ecf05 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:12:00.579809 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-34c22c50-59d2-49b8-9227-8995485ecf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:00.587813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1463/2894] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:12:00.592080 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7c688-a273-440f-a490-4e95b1507820 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:00.602194 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7c688-a273-440f-a490-4e95b1507820 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:00.606815 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:00.607421 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.607705 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.607985 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] PATH_INFO: `/v3/domains` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.608629 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=93391) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 24 07:12:00.608931 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:00.610567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:00.622427 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1432/2895] 10.222.0.59 () {58 vars in 1153 bytes} [Wed Aug 24 07:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 24 07:12:00.626743 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22c50-59d2-49b8-9227-8995485ecf05 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:00.636610 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c22c50-59d2-49b8-9227-8995485ecf05 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:00.641234 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:00.641822 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.642106 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.642382 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.643065 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:00.644965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:00.751492 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1464/2896] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:12:00 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:12:00.755857 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:00.766465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f4328-ae73-42eb-9cee-0440f226b80f admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:00.825602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:00.826242 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.826504 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.826807 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.827448 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:00.829454 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:00.837406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:12:00.940409 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1433/2897] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:12:00 2022] POST /identity/v3/users => generated 287 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:12:00.944481 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:00.955114 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68735e-cf3b-4feb-93db-b0299597aab7 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:00.959813 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:00.960407 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.960694 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.960969 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.961611 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:00.963264 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:00.973068 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1465/2898] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:12:00.977099 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:00.987429 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1cecd6-0022-4190-b2be-ccab9273c8c6 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:00.992215 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a668333-822c-49b3-b071-05f58c198935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:00.992828 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668333-822c-49b3-b071-05f58c198935 admin admin] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:00.993108 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668333-822c-49b3-b071-05f58c198935 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:00.993387 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a668333-822c-49b3-b071-05f58c198935 admin admin] PATH_INFO: `/v3/roles` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:00.994034 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a668333-822c-49b3-b071-05f58c198935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:00.996348 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a668333-822c-49b3-b071-05f58c198935 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:01.006860 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1434/2899] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:12:01.011066 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:01.021406 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594e1244-57e3-4248-ae6c-eff347aa1095 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:01.026177 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:01.026864 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] REQUEST_METHOD: `PUT` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:01.027148 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:01.027454 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] PATH_INFO: `/v3/projects/d3e865365d304f91a8d2889a17aea69c/users/487e9f277ea14c5195ba90797ee5bcb8/roles/85f11f9cbbe24bfba7dd40522c375e6d` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:01.042300 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3e865365d304f91a8d2889a17aea69c, user_id=487e9f277ea14c5195ba90797ee5bcb8, role_id=85f11f9cbbe24bfba7dd40522c375e6d)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:01.048175 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:01.198313 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1466/2900] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:12:01 2022] PUT /identity/v3/projects/d3e865365d304f91a8d2889a17aea69c/users/487e9f277ea14c5195ba90797ee5bcb8/roles/85f11f9cbbe24bfba7dd40522c375e6d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:12:01.203386 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a750f5-05f7-4e1b-b81c-3c2b669ab5d8 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:01.203695 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a750f5-05f7-4e1b-b81c-3c2b669ab5d8 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:01.203975 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a750f5-05f7-4e1b-b81c-3c2b669ab5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:01.223162 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-30a750f5-05f7-4e1b-b81c-3c2b669ab5d8 None None] MFA Rules not processed for user `6fcbd85e11364a39a93fb2a7be48da77`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:12:01.224390 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-30a750f5-05f7-4e1b-b81c-3c2b669ab5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:01.281271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1435/2901] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:12:01.290702 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:01.293077 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:01.349929 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e04c84-9422-4aac-a751-a55319419af9 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:01.353631 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:01.354747 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:01.355058 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:01.355338 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:01.364096 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:01.365520 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:01.375160 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1467/2902] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:12:06.665339 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f27158-a6c8-4a9d-9685-a08242dbb475 None None] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:06.665943 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f27158-a6c8-4a9d-9685-a08242dbb475 None None] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:06.666549 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f27158-a6c8-4a9d-9685-a08242dbb475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:06.698369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.auth.core [None req-88f27158-a6c8-4a9d-9685-a08242dbb475 None None] MFA Rules not processed for user `487e9f277ea14c5195ba90797ee5bcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=93391) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:12:06.699645 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-88f27158-a6c8-4a9d-9685-a08242dbb475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:06.776693 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1436/2903] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:12:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:12:06.781399 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:06.791786 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf02f790-0099-433f-8ffe-143582795712 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:06.796949 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:06.797558 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:06.797837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:06.798111 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:06.798779 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:06.800714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:06.896927 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1468/2904] 10.222.0.59 () {60 vars in 1153 bytes} [Wed Aug 24 07:12:06 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 24 07:12:06.901787 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f27158-a6c8-4a9d-9685-a08242dbb475 None None] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:06.913102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f27158-a6c8-4a9d-9685-a08242dbb475 None None] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:06.968401 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:06.969043 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] REQUEST_METHOD: `POST` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:06.969929 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:06.970222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] PATH_INFO: `/v3/users` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:06.970914 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:06.972888 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:07.075180 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:12:07.081169 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1437/2905] 10.222.0.59 () {60 vars in 1144 bytes} [Wed Aug 24 07:12:06 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 24 07:12:07.085244 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:07.098007 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e892c99-6bfe-46e4-971c-294dcbcddbb8 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:07.103220 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:07.103849 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:07.104130 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:07.104403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:07.105036 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:07.106624 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:07.117434 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1469/2906] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:12:07.122223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:07.132199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69d5d3c-4637-4310-b43c-4f489f5bf18a admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:07.137449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:07.138102 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:07.138455 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:07.138704 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] PATH_INFO: `/v3/projects/4261827b56474bc5908428b585f572d4/users/8a059e7fa3b74bb8b9c97f6df738ba18/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:07.153993 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4261827b56474bc5908428b585f572d4, user_id=8a059e7fa3b74bb8b9c97f6df738ba18, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:07.156764 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:07.238219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1438/2907] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:12:07 2022] PUT /identity/v3/projects/4261827b56474bc5908428b585f572d4/users/8a059e7fa3b74bb8b9c97f6df738ba18/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:12:07.242216 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:07.252970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208e0b3e-b5f4-4a1a-a1b8-04667d862688 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:07.256871 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:12:07.310363 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de19c643-f2ae-4d10-9ca8-eabf76a0cd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:07.311041 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c643-f2ae-4d10-9ca8-eabf76a0cd04 admin admin] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:07.311325 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c643-f2ae-4d10-9ca8-eabf76a0cd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:07.311603 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de19c643-f2ae-4d10-9ca8-eabf76a0cd04 admin admin] PATH_INFO: `/v3/roles` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:07.315565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c643-f2ae-4d10-9ca8-eabf76a0cd04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:07.315565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de19c643-f2ae-4d10-9ca8-eabf76a0cd04 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:07.324915 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1470/2908] 10.222.0.59 () {58 vars in 1122 bytes} [Wed Aug 24 07:12:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 24 07:12:07.329074 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:07.339327 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385aff52-edee-49e0-b604-09934837cc97 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:07.343921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:07.344567 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:07.344848 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:07.345127 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] PATH_INFO: `/v3/projects/4261827b56474bc5908428b585f572d4/users/8a059e7fa3b74bb8b9c97f6df738ba18/roles/91a8c0dd9a24482f9ba51352671aa49a` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:07.347085 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4261827b56474bc5908428b585f572d4, user_id=8a059e7fa3b74bb8b9c97f6df738ba18, role_id=91a8c0dd9a24482f9ba51352671aa49a)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:07.349738 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:07.362033 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1439/2909] 10.222.0.59 () {60 vars in 1483 bytes} [Wed Aug 24 07:12:07 2022] PUT /identity/v3/projects/4261827b56474bc5908428b585f572d4/users/8a059e7fa3b74bb8b9c97f6df738ba18/roles/91a8c0dd9a24482f9ba51352671aa49a => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:12:13.336419 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6693c-bbc8-4e79-8abc-61c249e88454 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:13.336962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6693c-bbc8-4e79-8abc-61c249e88454 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:13.336962 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec6693c-bbc8-4e79-8abc-61c249e88454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:13.365104 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-7ec6693c-bbc8-4e79-8abc-61c249e88454 None None] MFA Rules not processed for user `8a059e7fa3b74bb8b9c97f6df738ba18`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:12:13.366368 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-7ec6693c-bbc8-4e79-8abc-61c249e88454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:13.435803 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1471/2910] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:12:13 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:12:13.451263 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:13.453048 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:13.532822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da2e4f4-b317-49e6-bb07-a73cc31011f2 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:13.538271 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:13.538911 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:13.539196 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:13.539468 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:13.599406 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:13.601008 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:13.610633 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1440/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:12:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:12:16.364955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3654-c1f5-496e-b09f-d1b4b6ab6823 None None] REQUEST_METHOD: `POST` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:16.364955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3654-c1f5-496e-b09f-d1b4b6ab6823 None None] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:16.364955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27c3654-c1f5-496e-b09f-d1b4b6ab6823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:16.383412 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.auth.core [None req-a27c3654-c1f5-496e-b09f-d1b4b6ab6823 None None] MFA Rules not processed for user `487e9f277ea14c5195ba90797ee5bcb8`. Rule list: `[]` (Enabled: `True`). {{(pid=93390) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 24 07:12:16.385206 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-a27c3654-c1f5-496e-b09f-d1b4b6ab6823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:16.397791 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1472/2912] 10.222.0.59 () {58 vars in 958 bytes} [Wed Aug 24 07:12:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 24 07:12:23.606431 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=72,keystone:INSERT=2 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:12:26.377544 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=63 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:12:50.413416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:12:50.414853 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:12:50.472581 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bd278d-1738-4993-a92b-72ed45de4f23 service nova] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:12:50.476205 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:12:50.476801 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:12:50.477081 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:12:50.477354 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:12:50.486886 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:12:50.488303 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:12:50.497678 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1441/2913] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:12:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:13:00.493481 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=26 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:14:48.085627 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c3654-c1f5-496e-b09f-d1b4b6ab6823 None None] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:14:48.095445 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27c3654-c1f5-496e-b09f-d1b4b6ab6823 None None] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:14:48.099214 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:14:48.099807 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:14:48.100087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:14:48.100359 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:14:48.102080 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:14:48.115519 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:14:48.119565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:14:48.128756 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1473/2914] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:14:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:14:49.310524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:14:49.319835 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25f3c0-e89f-4b69-8e94-cde10fb67da3 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:14:49.323666 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:14:49.324251 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:14:49.324529 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:14:49.324803 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:14:49.326482 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:14:49.339559 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:14:49.340908 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:14:49.352222 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1442/2915] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:14:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:14:58.123619 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=6 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:14:59.346999 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=6 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:15:02.499087 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:15:02.507977 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be89b0-5f46-4e1b-b649-f7e09fe9e3da service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:15:02.511955 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:15:02.512547 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:15:02.512837 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:15:02.513112 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:15:02.514909 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:15:02.525225 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:15:02.526642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:15:02.534695 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1474/2916] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:15:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:15:03.138116 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:15:03.142953 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93170e53-4415-4798-827a-cdf978a8a96a service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:15:03.146585 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:15:03.147219 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:15:03.147524 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:15:03.147789 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:15:03.149519 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:15:03.158944 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:15:03.160419 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:15:03.169096 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1443/2917] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:15:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:15:03.254565 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:15:03.263482 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c7a898-1e3e-4d9c-adda-af7fcbb148a4 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:15:03.267057 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:15:03.267642 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:15:03.267919 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:15:03.268190 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:15:03.270905 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:15:03.287755 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:15:03.295327 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:15:03.304654 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1475/2918] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:15:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:15:03.364846 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:15:03.366300 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:15:03.435223 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d85fcc-08d7-476d-aa5c-6f68a9e32188 service neutron] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:15:03.440052 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:15:03.440649 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:15:03.440930 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:15:03.441204 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:15:03.442933 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:15:03.454779 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:15:03.456416 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:15:03.466973 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1444/2919] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:15:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:15:10.226494 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:15:10.235341 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143c3d7-67b1-4bef-a400-dbfbb6434772 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:15:10.239479 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '60b49283ccd0414389601e5e6f339c45', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:15:10.240082 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:15:10.240364 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:15:10.240645 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:15:10.242403 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:15:10.252542 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:15:10.253979 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:15:10.262374 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1476/2920] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:15:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:15:13.462561 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=38 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:15:20.258674 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=18 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:16:12.388822 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:16:12.390254 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:16:12.473958 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1187f-9efb-4890-a7f9-9a642c507b61 service placement] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:16:12.479088 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:16:12.479686 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:16:12.479971 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:16:12.480249 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:16:12.481970 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:16:12.493945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:16:12.495570 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:16:12.505449 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1445/2921] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:16:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:16:22.501203 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=37 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:16:28.966652 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:16:28.968200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:16:29.049297 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c52401f-6dd5-499f-a99e-29885d599e90 service neutron] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:16:29.055033 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a68d368b5d14b75aaba3bbb3f4bb62c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:16:29.055639 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:16:29.055922 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:16:29.056200 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:16:29.057943 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:16:29.070147 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:16:29.072563 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:16:29.083512 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1477/2922] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:16:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:16:34.436491 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:16:34.447369 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456589-4673-4c5b-b7d5-8ffde139b05a service placement] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:16:34.452321 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:16:34.452921 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] REQUEST_METHOD: `GET` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:16:34.453199 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:16:34.453471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:16:34.455355 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:16:34.467825 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:16:34.469450 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:16:34.483918 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1446/2923] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:16:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:16:38.221889 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:16:38.282511 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b95f041-ce1b-4631-b665-ef281cab26ff service nova] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:16:38.287099 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:16:38.287714 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:16:38.287992 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:16:38.288266 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] PATH_INFO: `/v3/users/487e9f277ea14c5195ba90797ee5bcb8` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:16:38.289366 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=487e9f277ea14c5195ba90797ee5bcb8)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:16:38.291333 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:16:38.474568 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '487e9f277ea14c5195ba90797ee5bcb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:38.475321 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '487e9f277ea14c5195ba90797ee5bcb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:38.564396 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '487e9f277ea14c5195ba90797ee5bcb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:38.572070 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '487e9f277ea14c5195ba90797ee5bcb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:38.584689 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '487e9f277ea14c5195ba90797ee5bcb8'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:38.590553 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1478/2924] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:16:38 2022] DELETE /identity/v3/users/487e9f277ea14c5195ba90797ee5bcb8 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:16:38.861889 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:16:38.874253 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5174bec-03ec-405f-9d66-df5ff0304cbb service placement] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:16:38.931264 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:16:38.932534 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:16:38.932816 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:16:38.933095 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] PATH_INFO: `/v3/projects/d3e865365d304f91a8d2889a17aea69c` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:16:38.934208 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3e865365d304f91a8d2889a17aea69c)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:16:38.936148 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:16:39.070851 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3e865365d304f91a8d2889a17aea69c', 'request_id': 'req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.077471 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3e865365d304f91a8d2889a17aea69c', 'request_id': 'req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.083311 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3e865365d304f91a8d2889a17aea69c', 'request_id': 'req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.196255 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] The token cache is being invalidate because project d3e865365d304f91a8d2889a17aea69c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:16:39.196465 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.198040 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.199654 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1447/2925] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:16:38 2022] DELETE /identity/v3/projects/d3e865365d304f91a8d2889a17aea69c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:16:39.203774 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:16:39.205194 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:16:39.218176 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d77bf2-f67c-4a94-8cad-305c8b88ff5a admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:16:39.225788 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:16:39.274226 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:16:39.274882 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:16:39.275193 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:16:39.275472 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] PATH_INFO: `/v3/users/8a059e7fa3b74bb8b9c97f6df738ba18` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:16:39.276669 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a059e7fa3b74bb8b9c97f6df738ba18)` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:16:39.278658 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:16:39.502641 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a059e7fa3b74bb8b9c97f6df738ba18'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.503318 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a059e7fa3b74bb8b9c97f6df738ba18'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.625625 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a059e7fa3b74bb8b9c97f6df738ba18'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.632965 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a059e7fa3b74bb8b9c97f6df738ba18'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.645254 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.notifications [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a059e7fa3b74bb8b9c97f6df738ba18'} {{(pid=93390) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:39.651167 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1479/2926] 10.222.0.59 () {58 vars in 1224 bytes} [Wed Aug 24 07:16:39 2022] DELETE /identity/v3/users/8a059e7fa3b74bb8b9c97f6df738ba18 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:16:39.886053 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Authenticating user token {{(pid=93391) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:16:39.887753 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.fernet_utils [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93391) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:16:39.901432 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f584dd-36ba-4c58-a2d4-769eb9b70a33 admin admin] Validating token access rules against request {{(pid=93391) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:16:39.957011 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6fcbd85e11364a39a93fb2a7be48da77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a64c6bc3685d4c718b6ea09aa1a4b7cf', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93391) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:16:39.957659 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:16:39.957945 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:16:39.958227 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] PATH_INFO: `/v3/projects/4261827b56474bc5908428b585f572d4` {{(pid=93391) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:16:39.959602 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4261827b56474bc5908428b585f572d4)` {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:16:39.961817 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] RBAC: Authorization granted {{(pid=93391) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:16:39.984717 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:16:40.117399 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4261827b56474bc5908428b585f572d4', 'request_id': 'req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:40.123743 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4261827b56474bc5908428b585f572d4', 'request_id': 'req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:40.129500 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4261827b56474bc5908428b585f572d4', 'request_id': 'req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5'} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:40.204111 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] The token cache is being invalidate because project 4261827b56474bc5908428b585f572d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=93391) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 24 07:16:40.204404 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:40.205036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG keystone.notifications [None req-88a743be-15b3-4893-9ffd-d5f5f8baa6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=93391) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 24 07:16:40.206594 dv-cinder-854272-1-smb devstack@keystone.service[93391]: [pid: 93391|app: 0|req: 1448/2927] 10.222.0.59 () {58 vars in 1233 bytes} [Wed Aug 24 07:16:39 2022] DELETE /identity/v3/projects/4261827b56474bc5908428b585f572d4 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 24 07:16:49.647731 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=48,keystone:DELETE=10,keystone:INSERT=1 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:16:50.201036 dv-cinder-854272-1-smb devstack@keystone.service[93391]: DEBUG dbcounter [-] [93391] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=93391) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 24 07:21:16.350970 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Authenticating user token {{(pid=93390) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 24 07:21:16.352397 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:21:16.422302 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e218f6-7615-4cb6-8fb4-678cb9aef266 admin admin] Validating token access rules against request {{(pid=93390) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 24 07:21:16.481546 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4a2e3f-5f8c-4dfe-b2d9-9527ed1b3cf1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c15217a015c4214b6769393fe48c1dd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '33bdcbe43e864e39b976072f52085dc0', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=93390) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 24 07:21:16.482155 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a2e3f-5f8c-4dfe-b2d9-9527ed1b3cf1 service placement] REQUEST_METHOD: `GET` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 24 07:21:16.482440 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a2e3f-5f8c-4dfe-b2d9-9527ed1b3cf1 service placement] SCRIPT_NAME: `/identity` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 24 07:21:16.482727 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4a2e3f-5f8c-4dfe-b2d9-9527ed1b3cf1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=93390) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 24 07:21:16.484541 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.fernet_utils [None req-fa4a2e3f-5f8c-4dfe-b2d9-9527ed1b3cf1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=93390) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 24 07:21:16.496581 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a2e3f-5f8c-4dfe-b2d9-9527ed1b3cf1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 24 07:21:16.498207 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4a2e3f-5f8c-4dfe-b2d9-9527ed1b3cf1 service placement] RBAC: Authorization granted {{(pid=93390) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 24 07:21:16.508056 dv-cinder-854272-1-smb devstack@keystone.service[93390]: [pid: 93390|app: 0|req: 1480/2928] 10.222.0.59 () {60 vars in 1365 bytes} [Wed Aug 24 07:21:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 24 07:21:26.503858 dv-cinder-854272-1-smb devstack@keystone.service[93390]: DEBUG dbcounter [-] [93390] Writing DB stats keystone:SELECT=58 {{(pid=93390) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}